-- Logs begin at Wed 2022-07-27 19:10:26 UTC, end at Wed 2022-07-27 21:02:00 UTC. -- Jul 27 20:04:19.152138 dv-cinder-851249-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 20:04:19.160007 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 20:04:19 2022] *** Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: nodename: dv-cinder-851249-1-iscsi Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: machine: x86_64 Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: clock source: unix Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: pcre jit disabled Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: detected number of CPU cores: 4 Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: current working directory: / Jul 27 20:04:19.162747 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: detected binary path: /usr/bin/uwsgi-core Jul 27 20:04:19.163326 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: your processes number limit is 47680 Jul 27 20:04:19.163326 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: your memory page size is 4096 bytes Jul 27 20:04:19.163326 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: detected max file descriptor number: 2048 Jul 27 20:04:19.163326 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: lock engine: pthread robust mutexes Jul 27 20:04:19.163326 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: thunder lock: enabled Jul 27 20:04:19.163326 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 20:04:19.163326 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 20:04:19.202793 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: Python main interpreter initialized at 0x5641147dc9c0 Jul 27 20:04:19.202793 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: python threads support enabled Jul 27 20:04:19.202793 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: your server socket listen backlog is limited to 100 connections Jul 27 20:04:19.202793 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: your mercy for graceful operations on workers is 90 seconds Jul 27 20:04:19.203159 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 20:04:19.203235 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: *** Operational MODE: preforking *** Jul 27 20:04:19.203449 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: *** uWSGI is running in multiple interpreter mode *** Jul 27 20:04:19.203449 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: spawned uWSGI master process (pid: 103733) Jul 27 20:04:19.203646 dv-cinder-851249-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 20:04:19.205623 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: spawned uWSGI worker 1 (pid: 103734, cores: 1) Jul 27 20:04:19.205623 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: spawned uWSGI worker 2 (pid: 103735, cores: 1) Jul 27 20:04:19.205623 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 20:04:19.869449 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 20:04:19.874383 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 20:04:20.969308 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:04:20.969308 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: from cryptography.utils import int_from_bytes Jul 27 20:04:20.970019 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:04:20.970019 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: from cryptography.utils import int_from_bytes Jul 27 20:04:20.975757 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:04:20.975757 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: from cryptography.utils import int_from_bytes Jul 27 20:04:20.976184 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:04:20.976184 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: from cryptography.utils import int_from_bytes Jul 27 20:04:23.466948 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 20:04:23.467514 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 20:04:23.467710 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 20:04:23.468069 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 20:04:23.468323 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 20:04:23.468728 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.469049 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.469367 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.469682 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.470006 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.470319 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.470635 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.470949 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.471271 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.471529 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.471621 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 20:04:23.471965 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 20:04:23.472058 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.472146 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-1-iscsi {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.472315 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 20:04:23.472483 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.472710 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 20:04:23.472810 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.472970 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 20:04:23.473058 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.473355 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.473443 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.473653 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.473789 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.473968 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.474101 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.474268 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.474400 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.474606 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.474754 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.475759 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.475890 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.475997 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.476110 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.476222 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.476326 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.476550 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.476664 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.476787 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.476959 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.477088 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.477253 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.477389 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-1-iscsi {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.477577 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.477721 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.477894 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.478101 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.478253 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.478473 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.478473 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.478795 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.478795 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.479136 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-1-iscsi {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.479320 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.479543 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.479738 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.479923 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.479923 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.480244 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.480476 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.480670 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.480856 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.481056 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.481206 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.481399 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.481565 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.481730 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.481856 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.482266 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.482399 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.482522 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.482728 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.482853 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.483003 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.483143 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.483274 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.483397 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.483528 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.483651 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.483772 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.483902 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-1-iscsi {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.484024 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.484153 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.484311 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.484454 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.484592 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.484716 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.484845 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.484974 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.485097 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.485219 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.485347 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.485470 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.485592 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.485720 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.485842 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.486023 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.486150 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.486338 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.486473 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.486596 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.486718 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.486848 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.487032 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.487172 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.487321 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.487448 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.487645 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.487758 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.487947 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.488036 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.488257 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.488343 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.488600 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.488700 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.488905 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.489002 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.489208 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.489301 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.489510 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.489602 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.489782 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.489874 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.490089 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.490175 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.490411 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.490495 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.490752 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.490848 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.491055 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.491149 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.491309 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.491394 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.491560 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.491744 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.491879 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.491992 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.492199 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.492286 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.492535 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.492627 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.492846 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.492933 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.493155 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.493240 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.493460 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.493554 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.493767 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.493853 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.494072 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.494166 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.494378 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.494463 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.494683 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.494779 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.494997 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.495088 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.495309 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.495392 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.495614 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.495699 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.495863 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.495947 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.496162 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.496259 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.496486 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.496645 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.496802 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.496888 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.497107 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.497216 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.497406 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.497516 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.497707 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.497842 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.498004 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.498129 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.498306 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.498449 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.498606 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.498772 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.498928 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.499067 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.499207 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.499371 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.499507 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.499677 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.499805 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.499996 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.500090 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.500327 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.500454 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.500658 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.500765 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.500911 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.500998 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.501214 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.501300 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.501520 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.501612 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.501836 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.501929 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.502142 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.502227 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.502446 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.502540 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.502754 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.502853 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.503051 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.503137 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.503353 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.503446 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.503655 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.503746 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.503956 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.504040 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.504277 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.504399 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.504577 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.504679 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.504877 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.504961 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.505178 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.505272 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.505480 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.505564 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.505774 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.505858 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.506077 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.506180 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.506416 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.506513 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.506720 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.506804 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.507019 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.507126 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.507322 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.507433 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.507618 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.507712 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.507918 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.508003 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.508217 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.508302 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.508540 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.508627 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.508839 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.508925 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.509135 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.509228 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.509441 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.509538 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.509754 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.509848 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.510056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.510141 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.510360 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.510444 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.510661 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.510745 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.510963 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.511059 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.511268 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.511362 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.511585 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.511677 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.511891 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.511975 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.512197 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.512290 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.512524 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.512613 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.512829 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.512916 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.513134 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.513241 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.513437 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.513522 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.513739 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.513824 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.514042 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.514129 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.514341 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.514425 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.514658 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.514743 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.514984 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.515096 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.515290 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.515385 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.515595 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.515696 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.515903 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.516004 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.516216 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.516313 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:04:23.516554 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.516657 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.516872 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.516971 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.517181 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.517280 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.517496 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.517596 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.517822 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.517949 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.518140 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.518231 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.518448 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.518549 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.518764 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.518855 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.519079 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.519192 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.519406 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.519564 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.519703 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.519852 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.520016 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.520167 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.520330 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.520517 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.520657 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.520801 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.520939 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.521075 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.521263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.521458 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.521601 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.521750 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.522382 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.522520 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.522704 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.522863 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.523001 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.523166 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.523304 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.523441 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.523606 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.523766 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.523904 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.524041 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.524209 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.524353 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.524564 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.524711 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.524877 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.525030 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.525189 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.525368 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.525519 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.525658 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.525801 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.525939 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.526075 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.526222 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.526367 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.526529 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.526679 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.526841 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.526992 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.527167 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.527319 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.527499 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.527642 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.527812 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.527961 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.528106 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.528252 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.528421 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.528566 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.528751 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.528895 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.529114 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.529256 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.529392 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.529526 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.529663 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.529799 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.529944 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.530101 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.530240 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.530377 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.530538 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.530682 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.530830 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.530968 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.531140 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.531284 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.531448 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.531599 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.531736 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.531872 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.532053 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.532219 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.532360 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.532546 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.532686 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.532829 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.532966 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.533102 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.533239 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.533389 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.533549 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.533694 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.533858 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.534011 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.534154 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.534299 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.534461 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.534605 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.534770 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.534914 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.535080 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.535237 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.535376 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.535513 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.535685 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.535828 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.535988 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.536124 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.536287 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.536455 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.536608 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.536746 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.536927 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.537072 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.537233 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.537376 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.538095 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.538244 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.538408 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.538554 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.538694 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.538830 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.538966 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.539111 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.539272 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.539423 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.539561 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.539707 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.539846 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.539991 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.540152 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.540314 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.540529 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.540676 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.540815 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.540960 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.541099 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.541235 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.541372 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.541508 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.541644 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.541790 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.541928 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.542065 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.542218 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.542368 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.542513 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.542650 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.542794 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.542961 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.543105 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.543288 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.543441 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.543613 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.543757 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.543931 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.544082 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.544229 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.544405 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.544553 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.544701 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.544846 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.544983 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.545214 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.545371 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.545509 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.545645 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.545788 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.545933 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.546090 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.546229 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.546365 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.546501 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.546645 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.546783 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.546927 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.547076 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.547222 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.547367 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.547510 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.547655 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.547809 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.547966 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.548106 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.548243 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.548423 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.548569 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.548718 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.548856 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.549016 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.549160 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.549324 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.549478 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.549665 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.549810 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.550002 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.550154 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.550320 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.550473 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.550617 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.550760 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.550937 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.551087 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.551248 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.551404 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.551549 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.551687 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.551851 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.552012 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.552156 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.552303 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.552484 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.552627 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.552764 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.552899 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.553089 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.553246 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.553393 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.553531 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.553702 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.553846 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.554023 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.554168 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.554332 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.554483 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.554647 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.554797 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.554956 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.555098 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.555241 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.555389 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.555555 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.555705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.555885 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.556046 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.556196 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.556347 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.556542 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.556687 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.556846 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.556993 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.557135 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.557288 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.557432 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.557649 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.557795 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.557953 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.558096 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.558246 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.558390 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.558541 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.558686 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.558828 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.558969 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.559111 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.559261 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.559417 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.559561 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.559712 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.559866 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.560009 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.560152 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.560306 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.560478 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.560626 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.560779 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.560930 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.561074 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.561233 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.561385 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.561529 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.561671 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.561829 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.561989 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.562141 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.562285 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.562427 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.562576 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.562720 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.562871 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.563023 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.563167 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.563309 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.563452 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.563594 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.563755 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.563912 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.564056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.564295 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.564494 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.564644 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.564800 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.564953 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.565105 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.565266 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.565410 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.565562 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.565717 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.565861 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.566005 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.566148 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.566298 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.566455 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.566601 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.566745 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.566887 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.567037 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.567192 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.567345 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.567490 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.567650 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.567793 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.567954 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.568099 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.568255 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.568418 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.568568 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.569250 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.569402 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.569555 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.569701 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.569843 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.569985 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.570147 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.570291 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.570443 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.570593 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.570744 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.570889 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.571031 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.571174 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.571329 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.571474 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.571617 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.571772 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.571916 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.572069 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.572225 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.572368 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.572565 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.572720 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.572871 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.573022 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.573165 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.573308 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.573450 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.573603 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.573753 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.573904 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.574058 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.574208 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.574352 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.574494 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.574644 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.574797 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.574940 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.575082 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.575233 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.575385 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.575529 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.575679 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.575840 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.575983 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.576126 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.576268 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.576432 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.576600 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.576754 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.576899 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.577048 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.577208 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.577352 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.577495 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.577645 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.577800 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.577943 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.578093 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.578236 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.578388 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.578544 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.578690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.578832 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.578981 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.579131 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.579283 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.579427 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.579570 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.579729 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.579873 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.580015 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.580165 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.580308 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.580518 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.580666 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.580808 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.580960 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.581112 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.581336 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.581482 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.581637 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.581781 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.581923 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.582072 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.582225 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.582368 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.582519 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.582662 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.582804 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.582954 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.583098 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.583240 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.583388 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.583541 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.583692 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.583846 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.583989 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.584132 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.584274 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.584494 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.584590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.585236 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.585373 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.585542 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.585691 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.585849 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.586000 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.586151 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.586312 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.586459 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.586624 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.586764 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.586947 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.587072 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.587258 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.587377 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.587564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.587677 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.587873 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.587985 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.588179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.588287 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.588552 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.588717 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.588878 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.589031 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.589175 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.589318 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.589491 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.589642 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.589837 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.590012 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.590167 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.590311 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.590454 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.590606 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.590750 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.590893 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.591043 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.591199 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.591344 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.591500 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.591652 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.591796 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.591949 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.592093 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.592243 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.592431 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.592595 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.592740 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.592882 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.593024 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.593168 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.593319 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.593469 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.593620 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.593770 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.593924 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.594076 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.594222 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.594365 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.594509 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.594651 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.594793 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.594943 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.595094 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.595238 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.595381 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.595534 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.595679 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.595844 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.595989 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.596139 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.596284 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.596455 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.596615 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.596769 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.596921 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.597065 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.597214 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.597359 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.597510 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.597672 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.597817 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.597960 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.598121 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.598265 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.598422 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.598567 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.598710 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.598853 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.598996 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.599138 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.599290 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.599434 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.599587 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.599731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.599875 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.600094 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.600302 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.600567 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.600775 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.600970 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.601174 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.601388 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.601537 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.601680 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.601823 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.601976 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.602128 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.602283 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.602427 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.602570 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.602713 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.602855 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.602997 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.603147 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.603292 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.603433 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.603583 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.603727 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.603880 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.604037 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.604182 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.604323 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.604505 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.604651 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.604804 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.604956 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.605100 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.605242 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.605391 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.605534 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.605690 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.605846 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.605990 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.606139 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.606283 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.606425 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.606582 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.606735 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.606880 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.607272 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.607425 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.607569 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.607719 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.607879 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.608022 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.608164 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.608307 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.608485 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.608632 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.608775 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.608919 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.609061 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.609204 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.609359 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.609517 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.609660 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.609814 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.609969 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.610113 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.610331 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.610478 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.610641 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.610741 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.610826 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.610907 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611001 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611084 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611165 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611244 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611323 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611403 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611491 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611581 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611671 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611838 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.611937 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.612152 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.612242 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.612476 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.612569 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.612786 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.612877 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.613090 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.613181 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.613397 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.613493 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.613698 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.613786 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.614019 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.614173 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.614317 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.614468 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.614613 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.614762 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.614915 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.615068 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.615212 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.615354 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.615496 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.615677 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.615830 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.615981 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.616125 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.616268 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.616456 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.616620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.616766 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.616926 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.617077 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.617221 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.617491 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.617801 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.617950 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.618093 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.618235 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.618385 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.618536 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.618692 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.618847 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.618991 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.619144 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.619287 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.619443 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.619594 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.619738 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.619888 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.620032 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.620174 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.620330 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.620534 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.620689 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.620833 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.620982 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.621164 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.621325 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.621510 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.621658 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.621809 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.621952 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.622156 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.622321 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.622467 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.622611 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.622753 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.622895 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.623055 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.623199 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.623367 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.623517 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.623694 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.623907 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.624112 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.624261 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.624438 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.624589 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.624733 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.624896 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.625068 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.625225 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.625368 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.625546 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.625800 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.626104 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.626269 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.626415 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.626565 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.626791 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.626953 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.627115 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.627259 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.627401 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.627567 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.627712 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.627863 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.628017 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.628248 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.628436 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.628589 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.628734 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.628877 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.629028 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.629180 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.629333 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.629488 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.629639 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.629783 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.629926 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.630068 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.630223 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.630365 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.630510 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.630659 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.630803 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.630955 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.631099 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.631767 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.631927 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.632081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.632233 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.632436 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.632588 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.632742 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.632893 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.633049 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.633200 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.633353 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.633497 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.633640 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.633782 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.633935 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.634080 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.634235 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.634379 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.634521 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.634664 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.634833 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.634977 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.635129 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.635274 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.635416 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.635566 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.635709 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.635870 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.636015 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.636158 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.636301 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.636464 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.636612 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.636767 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.636943 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.637104 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.637251 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.637394 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.637537 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.637704 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.637848 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.637991 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.638170 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.638321 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.638479 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.638625 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.638774 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.638919 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.639095 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.639246 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.639399 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.639544 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.639698 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.639842 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.640014 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.640165 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.640316 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.640517 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.640673 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.640818 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.640961 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.641104 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.641259 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.641412 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.641564 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.641719 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.641862 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.642014 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.642166 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.642310 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.642454 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.642596 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.642745 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.642934 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.643091 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.643244 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.643388 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.643539 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.643693 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.643850 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.643994 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.644138 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.644280 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.644447 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.644599 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.644755 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.644899 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.645043 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.645185 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.645329 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.645490 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.645638 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.645780 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.645930 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.646074 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.646216 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.646367 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.646511 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.646661 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.646824 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.647509 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.647664 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.647822 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.647976 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.648119 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.648262 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.648427 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.648589 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.648747 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.648903 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.649053 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.649198 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.649340 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.649560 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.649713 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.649859 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.650012 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.650155 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.650298 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.650449 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.650599 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.650750 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.650903 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.651054 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.651207 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.651359 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.651507 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.651657 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.651854 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.652016 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.652161 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.652314 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.652522 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.652668 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.652811 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.652965 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.653128 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.653273 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.653417 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.653560 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.653702 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.653855 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.654012 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.654156 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.654300 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.654442 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.654585 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.654728 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.654883 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.655036 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.655180 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.655323 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.655465 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.655608 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.655769 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.655915 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.656104 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.656267 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.656439 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.656602 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.656749 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.656904 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.657050 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.657202 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.657346 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.657497 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.657676 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.657832 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.657975 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.658125 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.658282 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.658433 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.658576 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.658720 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.658870 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.659014 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.659165 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.659310 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.659463 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.659608 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.659758 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.659902 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.660052 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.660318 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.660522 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.660678 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.660822 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.660974 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.661128 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.661280 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.661426 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.661578 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.661729 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.661881 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.662033 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.662184 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.662329 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.662530 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.662682 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.662834 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.662979 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.663130 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.663292 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.663453 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.663605 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.663758 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.663900 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.664074 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.664258 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.664420 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.664584 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.664765 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.664917 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.665088 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.665238 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.665392 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.665550 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.665702 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.665846 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.666012 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.666163 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.666370 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.666538 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.666684 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.666826 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.666978 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.667130 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.667294 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.667439 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.667581 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.667732 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.667883 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.668028 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.668198 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.668345 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.668559 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.668707 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.668850 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.668993 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.669144 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.669300 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.669451 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.669595 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.669748 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.669924 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.670076 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.670228 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.670372 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.670546 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.670697 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.670851 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.670996 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.671150 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.671302 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.671454 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.671599 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.671773 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.671926 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.672077 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.672223 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.672365 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.672695 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.672854 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.673007 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.673151 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.673305 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.673449 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.673601 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.673756 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.673901 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.674045 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.674188 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.674330 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.674482 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.674627 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.674771 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.674913 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.675064 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.675218 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.675369 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.675520 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.675664 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.675807 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.675958 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.676111 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.676255 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.676461 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.676614 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.676758 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.676902 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.677073 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.677232 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.677378 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.677521 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.677665 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.677816 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.678032 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.678287 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.678463 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.678622 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.678768 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.678920 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.679074 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.679237 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.679390 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.679541 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.679686 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.679838 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.679984 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.680127 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.680271 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.680437 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.680588 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.680744 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.680890 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.681035 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.681189 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.681334 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.681478 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.681629 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.681774 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.681918 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.682062 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.682205 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.682349 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.682509 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.682654 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.682798 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.682940 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.683094 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.683245 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.683391 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.683613 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.683781 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.683936 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.684081 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.684240 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.684427 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.684582 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.684727 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.684871 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.685029 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.685185 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.685329 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.685473 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.685616 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.685759 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.685903 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.686059 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.686205 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.686356 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.686500 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.686657 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.686810 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.686964 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.687109 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.687252 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.687395 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.687539 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.687694 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.687839 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.687982 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.688133 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.688278 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.688444 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.688611 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.688758 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.688923 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.689076 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.689227 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.689378 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.689532 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.689685 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.689830 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.689974 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.690117 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.690268 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.690413 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.690556 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.690711 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.690856 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.691000 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.691152 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.691303 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.691448 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.691591 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.691760 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.691913 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.692066 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.692209 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.692352 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.692631 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.692796 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.692952 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.693103 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.693249 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.693391 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.693557 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.694221 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.694437 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.694592 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.694744 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.694890 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.695034 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.695189 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.695342 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.695485 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.695662 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.695813 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.695964 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.696108 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.696260 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.696431 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.696594 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.696739 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.696904 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.697105 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.697266 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.697410 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.697555 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.697705 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.697849 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.698000 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.698145 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.698287 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.698430 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.698572 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.698732 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.698902 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.699059 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.699211 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.699355 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.699506 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.699659 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.699813 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.699958 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.700101 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.700251 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.700454 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.700622 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.700768 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.700921 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.701065 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.701209 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.701352 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.701504 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.701655 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.701800 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.701948 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.702092 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.702248 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.702393 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.702542 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.702686 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.702839 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.702983 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.703138 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.703290 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.703434 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.703578 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.703728 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.703874 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.704026 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.704170 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.704314 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.704488 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.704634 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.704805 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.704957 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.705102 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.705245 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.705388 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.705530 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.705685 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.705837 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.705982 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.706125 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.706268 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.706419 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.706649 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.706797 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.706940 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.707083 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.707227 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.707369 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.707530 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.707675 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.707818 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.707969 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.708113 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.708268 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.708458 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.708622 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.708766 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.708910 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.709053 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.709204 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.709398 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.710040 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.710186 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.710338 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.710489 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.710648 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.710793 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.710937 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.711090 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.711235 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.711379 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.711530 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.711676 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.711819 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.711962 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.712106 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.712261 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.712429 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.712581 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.712726 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.712884 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.713028 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.713183 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.713335 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.713480 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.713631 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.713784 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.713929 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.714081 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.714226 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.714376 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.714523 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.714666 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.714834 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.714980 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.715124 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.715267 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.715417 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.715561 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.715713 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.715859 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.716010 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.716155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.716298 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.716483 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.716653 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.716798 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.716943 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.717093 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.717244 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.717396 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.717550 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.717695 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.717845 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.717990 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.718140 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.718293 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.718437 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.718591 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.718734 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.718884 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.719029 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.719185 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.719329 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.719472 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.719622 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.719766 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.719909 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.720062 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.720207 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.720366 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.720536 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.720681 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.720836 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.720981 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.721125 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.721268 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.721417 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.721599 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.721762 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.721908 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.722051 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.722203 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.722358 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.722501 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.722657 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.722802 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 20:04:23.722946 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.723180 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.723507 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.723828 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.724150 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.724490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.724804 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.725159 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.725503 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.725786 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.726097 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.726410 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.726721 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.727036 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.727347 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.727659 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.727975 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.728291 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.728651 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.728978 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.729291 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.729618 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.729944 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.730292 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.730604 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.730946 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.731273 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.731589 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.731904 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.732511 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:04:23.732760 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 20:04:23.876930 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO dbcounter [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Registered counter for database nova_api Jul 27 20:04:23.885558 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO dbcounter [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Registered counter for database nova_api Jul 27 20:04:23.898498 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_db.sqlalchemy.engines [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:04:23.905091 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writer thread running {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:04:23.905357 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:04:23.911801 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writer thread running {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:04:23.961072 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.context [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),deef0dc2-6aba-4ad7-810e-4420c759a7c1(cell1) {{(pid=103734) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 20:04:23.965046 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:04:23.966624 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:04:23.967413 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:04:23.967964 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.context [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),deef0dc2-6aba-4ad7-810e-4420c759a7c1(cell1) {{(pid=103735) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 20:04:23.969402 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:04:23.971369 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO dbcounter [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Registered counter for database nova_cell0 Jul 27 20:04:23.971924 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:04:23.973556 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:04:23.974343 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:04:23.976896 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:04:23.977348 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO dbcounter [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Registered counter for database nova_cell1 Jul 27 20:04:23.978871 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO dbcounter [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Registered counter for database nova_cell0 Jul 27 20:04:23.984665 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO dbcounter [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Registered counter for database nova_cell1 Jul 27 20:04:23.985340 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_db.sqlalchemy.engines [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:04:23.987128 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_db.sqlalchemy.engines [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:04:23.991867 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:04:23.992758 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writer thread running {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:04:23.993694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:04:23.995435 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writer thread running {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:04:23.998714 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writer thread running {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:04:24.004331 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writer thread running {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:04:24.143666 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO dbcounter [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Registered counter for database nova_cell0 Jul 27 20:04:24.148344 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO dbcounter [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Registered counter for database nova_cell0 Jul 27 20:04:24.152503 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_db.sqlalchemy.engines [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:04:24.155261 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:04:24.157181 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writer thread running {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:04:24.159541 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writer thread running {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:04:24.568441 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: WARNING keystonemiddleware.auth_token [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:04:24.576237 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: WARNING keystonemiddleware.auth_token [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:04:24.588159 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: WARNING keystonemiddleware.auth_token [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:04:24.595339 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: WARNING keystonemiddleware.auth_token [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:04:24.916113 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: WARNING keystonemiddleware.auth_token [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:04:24.922283 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: WARNING keystonemiddleware.auth_token [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:04:24.927452 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5641147dc9c0 pid: 103734 (default app) Jul 27 20:04:24.930079 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:04:24.931242 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Jul 27 20:04:24.931637 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Wed Jul 27 20:04:24 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:04:24.937382 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: WARNING keystonemiddleware.auth_token [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:04:24.943290 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: WARNING keystonemiddleware.auth_token [None req-e8d19b2e-02d8-4b55-a652-893891410ca3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:04:24.949144 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5641147dc9c0 pid: 103735 (default app) Jul 27 20:05:43.205115 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:05:43.206119 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 27 20:05:43.206499 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:05:43.218155 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_api:SELECT=3 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:05:43.219421 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_cell0:SELECT=3 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:05:43.220280 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_cell1:SELECT=3 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:05:43.221181 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:05:44.095359 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-2b03abfa-03cf-4140-921f-2a2fa7afa505 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:05:44.126762 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-2b03abfa-03cf-4140-921f-2a2fa7afa505 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913603 Jul 27 20:05:44.127517 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jul 27 20:05:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:05:46.350891 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:05:46.351834 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-bea5f9b3-5991-4a24-b7db-376e7f518da0 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Jul 27 20:05:46.356729 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:05:46.810749 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-412f68e7-e286-4e77-bb6d-34027ad03b14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:46.831414 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:05:46.831414 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: warnings.warn(msg) Jul 27 20:05:46.955947 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-412f68e7-e286-4e77-bb6d-34027ad03b14 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.596927 Jul 27 20:05:46.956922 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:05:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:05:46.971312 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_api:SELECT=3 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:05:46.972631 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_cell1:SELECT=3 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:05:46.973552 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_cell0:SELECT=3 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:05:46.974212 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:05:47.183029 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-b0033add-b6ce-4c89-8cbd-514f530fe071 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:47.187335 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:05:47.187335 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: warnings.warn(msg) Jul 27 20:05:47.335035 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-b0033add-b6ce-4c89-8cbd-514f530fe071 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369620 Jul 27 20:05:47.337567 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 20:05:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:05:49.547261 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-412f68e7-e286-4e77-bb6d-34027ad03b14 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:05:49.548330 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-412f68e7-e286-4e77-bb6d-34027ad03b14 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jul 27 20:05:49.548926 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:05:50.211954 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-c8874d4d-6a91-40bd-9bdc-407e440e972d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:50.231487 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:05:50.231487 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: warnings.warn(msg) Jul 27 20:05:50.368838 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-c8874d4d-6a91-40bd-9bdc-407e440e972d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.813357 Jul 27 20:05:50.369484 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:05:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:05:50.382195 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-02b9cef2-acc8-4c5c-9bfa-2234e4f98569 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:50.385595 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:05:50.385595 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: warnings.warn(msg) Jul 27 20:05:50.497508 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-02b9cef2-acc8-4c5c-9bfa-2234e4f98569 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118977 Jul 27 20:05:50.498448 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 20:05:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:05:52.713066 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-c8874d4d-6a91-40bd-9bdc-407e440e972d admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:05:52.714177 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-c8874d4d-6a91-40bd-9bdc-407e440e972d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Jul 27 20:05:52.714683 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:05:53.102342 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-d0f92360-9662-475e-be70-51f17eb48d65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "ram": 1024, "disk": 10, "vcpus": 1}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:53.180888 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-d0f92360-9662-475e-be70-51f17eb48d65 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459881 Jul 27 20:05:53.181474 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:05:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:05:53.193300 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-561932a5-b547-4108-a7ae-be67aefa906c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:53.272478 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-561932a5-b547-4108-a7ae-be67aefa906c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082801 Jul 27 20:05:53.273068 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 20:05:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:05:55.463562 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-d0f92360-9662-475e-be70-51f17eb48d65 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:05:55.464608 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-d0f92360-9662-475e-be70-51f17eb48d65 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 27 20:05:55.465003 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:05:55.931458 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-b4d77080-762b-4425-8767-da0b09887f72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:56.013675 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-b4d77080-762b-4425-8767-da0b09887f72 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.542871 Jul 27 20:05:56.014701 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:05:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:05:56.026500 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-3b99de9f-74b7-405a-bfd5-aa2ec98b1526 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:56.125916 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-3b99de9f-74b7-405a-bfd5-aa2ec98b1526 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103446 Jul 27 20:05:56.126602 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 20:05:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:05:58.324790 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-b4d77080-762b-4425-8767-da0b09887f72 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:05:58.325803 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-b4d77080-762b-4425-8767-da0b09887f72 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 27 20:05:58.326360 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:05:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:05:58.784939 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-7490a0f1-9ae5-4ae0-a73b-3bce47168d2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:58.870769 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-7490a0f1-9ae5-4ae0-a73b-3bce47168d2c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.536906 Jul 27 20:05:58.871279 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:05:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:05:58.883755 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-ec68c456-8538-4412-8236-5985292530e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:05:58.973884 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-ec68c456-8538-4412-8236-5985292530e9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094287 Jul 27 20:05:58.974873 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 20:05:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:06:01.470292 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-7490a0f1-9ae5-4ae0-a73b-3bce47168d2c admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:01.472010 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-7490a0f1-9ae5-4ae0-a73b-3bce47168d2c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Jul 27 20:06:01.472754 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:06:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:01.912616 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-7d3876d8-82e2-4818-b530-66b14f52f793 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:01.945486 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-7d3876d8-82e2-4818-b530-66b14f52f793 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465122 Jul 27 20:06:01.946193 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jul 27 20:06:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:06:04.273428 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-7490a0f1-9ae5-4ae0-a73b-3bce47168d2c admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:04.275030 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-7490a0f1-9ae5-4ae0-a73b-3bce47168d2c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Jul 27 20:06:04.275442 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:04.704306 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-5d9e230d-fcfa-400c-a25f-145f28384c07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:04.784164 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-5d9e230d-fcfa-400c-a25f-145f28384c07 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.502776 Jul 27 20:06:04.784774 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:06:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:04.797045 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-dd1e8ac1-9da2-408d-907e-962f40ae13d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:04.888199 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-dd1e8ac1-9da2-408d-907e-962f40ae13d0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094614 Jul 27 20:06:04.888760 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 20:06:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:06:07.156298 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-5d9e230d-fcfa-400c-a25f-145f28384c07 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:07.157343 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-5d9e230d-fcfa-400c-a25f-145f28384c07 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 27 20:06:07.157741 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:06:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:07.554680 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-5ff89aee-d5c2-4890-8561-1c607f81e696 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:07.684434 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-5ff89aee-d5c2-4890-8561-1c607f81e696 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.520924 Jul 27 20:06:07.684992 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:06:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:07.697628 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-35333471-31bf-4ed1-bfb5-20733282382c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:07.784709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-35333471-31bf-4ed1-bfb5-20733282382c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091334 Jul 27 20:06:07.785219 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 20:06:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:06:09.981976 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-5ff89aee-d5c2-4890-8561-1c607f81e696 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:09.982984 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-5ff89aee-d5c2-4890-8561-1c607f81e696 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 27 20:06:09.983380 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:10.342959 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-c2d07238-78e8-4523-a892-399628246628 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:10.418598 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-c2d07238-78e8-4523-a892-399628246628 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.428844 Jul 27 20:06:10.419144 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:06:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:06:10.431580 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-d3620a58-9935-4afb-9282-33b423e996f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:10.525455 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-d3620a58-9935-4afb-9282-33b423e996f3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098082 Jul 27 20:06:10.526274 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 20:06:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:06:12.803405 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-c2d07238-78e8-4523-a892-399628246628 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:12.804449 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-c2d07238-78e8-4523-a892-399628246628 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 27 20:06:12.804881 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:13.254863 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-9ae1c951-18b3-4ef7-b577-307e6bcf8100 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "swap": 0, "disk": 80, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:13.340248 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:06:13.348762 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-9ae1c951-18b3-4ef7-b577-307e6bcf8100 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.537707 Jul 27 20:06:13.350576 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:06:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:13.363258 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-748861d3-1f68-4354-af32-4f442a28fbff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:13.471011 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-748861d3-1f68-4354-af32-4f442a28fbff admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112998 Jul 27 20:06:13.471813 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 20:06:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:06:15.699539 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-9ae1c951-18b3-4ef7-b577-307e6bcf8100 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:15.700659 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-9ae1c951-18b3-4ef7-b577-307e6bcf8100 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 27 20:06:15.701242 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:16.170767 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-3d13f6cf-5334-4ed3-a7c5-0774384ecad0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "disk": 160}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:16.264748 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-3d13f6cf-5334-4ed3-a7c5-0774384ecad0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.557375 Jul 27 20:06:16.272742 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 20:06:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:16.278394 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-6dd5ec7b-ea6a-4b30-a8e1-5f1dd58f7f2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:16.354101 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-6dd5ec7b-ea6a-4b30-a8e1-5f1dd58f7f2a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079606 Jul 27 20:06:16.368411 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 20:06:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:06:37.162405 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-3d13f6cf-5334-4ed3-a7c5-0774384ecad0 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:37.163447 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-3d13f6cf-5334-4ed3-a7c5-0774384ecad0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 27 20:06:37.163845 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:37.550704 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-05777f65-fad2-4240-8622-95a41d9ee2ea admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:37.568981 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-05777f65-fad2-4240-8622-95a41d9ee2ea admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399142 Jul 27 20:06:37.569502 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jul 27 20:06:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:06:38.626514 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-3d13f6cf-5334-4ed3-a7c5-0774384ecad0 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:38.627506 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-3d13f6cf-5334-4ed3-a7c5-0774384ecad0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 27 20:06:38.627915 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:39.144218 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-57a094c3-9c20-4321-b602-c09f1a234d6b admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:39.149790 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.wsgi [None req-57a094c3-9c20-4321-b602-c09f1a234d6b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-57a094c3-9c20-4321-b602-c09f1a234d6b admin admin] Request method failure captured: Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Accept: application/json Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Accept-Encoding: gzip, deflate Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Connection: keep-alive Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Content-Length: 0 Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Host: 10.222.0.47 Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Openstack-Api-Version: compute 2.90 Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Openstack-System-Scope: None Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: User-Agent: python-novaclient Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Auth-Token: gAAAAABi4ZrOAUjiE98cuowy0r6ApcYPuXdcCbAgaIGfmnHxpzhka3ZW3fnSCt9-p-yvW-mNmuU_UxRJY4g7phN_llQasHbM2c1CLCKufbfvKppgOVNXcHnz7xctjE2DCzDllx5ZPfa7YTVSg5u0IOw14EiTsndcEo7NSG2DWZbT28WOz6FfVVk Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Domain-Id: None Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Domain-Name: None Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Identity-Status: Confirmed Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Is-Admin-Project: True Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Domain-Id: default Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Domain-Name: Default Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Name: admin Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Role: admin,reader,member Jul 27 20:06:39.153081 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Roles: admin,reader,member Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_285f06e24b5441ccbaca698e1fbd1162", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Tenant: admin Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Tenant-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Tenant-Name: admin Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User: admin Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Domain-Id: default Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Domain-Name: Default Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Id: bf4d4f6d05b846a9b37142cd6195bb44 Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Name: admin Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: method: > Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: exception: Flavor 42 could not be found. Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: action_args: {'id': '42'} Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:06:39.154694 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:39.155590 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.156967 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-57a094c3-9c20-4321-b602-c09f1a234d6b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:06:39.158258 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-57a094c3-9c20-4321-b602-c09f1a234d6b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387806 Jul 27 20:06:39.158258 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jul 27 20:06:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:06:39.164184 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-112ee361-8443-4b6e-bd3b-af91946c05aa admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:39.170509 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:06:39.189846 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-112ee361-8443-4b6e-bd3b-af91946c05aa admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029230 Jul 27 20:06:39.190405 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 20:06:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:06:39.200964 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-4014751c-b802-4948-8429-739ec8535730 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:39.224311 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-4014751c-b802-4948-8429-739ec8535730 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026902 Jul 27 20:06:39.224864 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 20:06:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:06:39.234087 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-1b115b22-c82b-43d8-9edf-d8acf520d8ee admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:39.240360 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.wsgi [None req-1b115b22-c82b-43d8-9edf-d8acf520d8ee admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-1b115b22-c82b-43d8-9edf-d8acf520d8ee admin admin] Request method failure captured: Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Accept: application/json Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Accept-Encoding: gzip, deflate Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Connection: keep-alive Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Content-Length: 0 Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Host: 10.222.0.47 Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Openstack-Api-Version: compute 2.90 Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Openstack-System-Scope: None Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: User-Agent: python-novaclient Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Auth-Token: gAAAAABi4ZrOAUjiE98cuowy0r6ApcYPuXdcCbAgaIGfmnHxpzhka3ZW3fnSCt9-p-yvW-mNmuU_UxRJY4g7phN_llQasHbM2c1CLCKufbfvKppgOVNXcHnz7xctjE2DCzDllx5ZPfa7YTVSg5u0IOw14EiTsndcEo7NSG2DWZbT28WOz6FfVVk Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Domain-Id: None Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Domain-Name: None Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Identity-Status: Confirmed Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Is-Admin-Project: True Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Domain-Id: default Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Domain-Name: Default Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Name: admin Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Role: admin,reader,member Jul 27 20:06:39.244230 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Roles: admin,reader,member Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_285f06e24b5441ccbaca698e1fbd1162", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Tenant: admin Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Tenant-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Tenant-Name: admin Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User: admin Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Domain-Id: default Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Domain-Name: Default Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Id: bf4d4f6d05b846a9b37142cd6195bb44 Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Name: admin Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: method: > Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: exception: Flavor 42 could not be found. Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: action_args: {'id': '42'} Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:06:39.249731 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:39.250719 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:39.251996 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-1b115b22-c82b-43d8-9edf-d8acf520d8ee admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103734) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:06:39.253341 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-1b115b22-c82b-43d8-9edf-d8acf520d8ee admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015097 Jul 27 20:06:39.253341 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jul 27 20:06:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:06:40.209499 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-4014751c-b802-4948-8429-739ec8535730 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:40.211169 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-4014751c-b802-4948-8429-739ec8535730 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Jul 27 20:06:40.211558 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:40.733612 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8307053a-94d1-489a-9aa6-6124171edaff admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:40.739168 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.wsgi [None req-8307053a-94d1-489a-9aa6-6124171edaff admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8307053a-94d1-489a-9aa6-6124171edaff admin admin] Request method failure captured: Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Accept: application/json Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Accept-Encoding: gzip, deflate Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Connection: keep-alive Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Content-Length: 0 Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Host: 10.222.0.47 Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Openstack-Api-Version: compute 2.90 Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Openstack-System-Scope: None Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: User-Agent: python-novaclient Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Auth-Token: gAAAAABi4ZrQWMSC1PV0kf5ndPne-6ivEnmEEi-tl0tH9jDFZXxDCs5K2IM17-su36dR9rYiBMv9ioCFcmw_xPxW1BxKgzQn8vXhGqqyo_xwF-gxcCHTzfS8eQJRn8QpluP14t_hvL0gWmkcX_pO1zt6CrGTTIVG2PfPLNo5nMpjEFcZyD2NCzU Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Domain-Id: None Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Domain-Name: None Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Identity-Status: Confirmed Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Is-Admin-Project: True Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Domain-Id: default Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Domain-Name: Default Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Name: admin Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Role: admin,reader,member Jul 27 20:06:40.740690 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Roles: admin,reader,member Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_285f06e24b5441ccbaca698e1fbd1162", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Tenant: admin Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Tenant-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Tenant-Name: admin Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User: admin Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Domain-Id: default Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Domain-Name: Default Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Id: bf4d4f6d05b846a9b37142cd6195bb44 Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Name: admin Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: method: > Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: exception: Flavor 84 could not be found. Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: action_args: {'id': '84'} Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:06:40.742709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:40.743525 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.744620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8307053a-94d1-489a-9aa6-6124171edaff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103734) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:06:40.745641 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-8307053a-94d1-489a-9aa6-6124171edaff admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395657 Jul 27 20:06:40.745641 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jul 27 20:06:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:06:40.752530 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-3a768704-19cb-495f-9e14-c1b59403111b admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:40.771098 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-3a768704-19cb-495f-9e14-c1b59403111b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022343 Jul 27 20:06:40.771632 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 20:06:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:06:40.781454 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-f7acd5ee-8781-4632-8191-da64513ea167 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:40.796809 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-f7acd5ee-8781-4632-8191-da64513ea167 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018892 Jul 27 20:06:40.797351 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 20:06:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:06:40.806954 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-a4df8524-ae05-4f5f-b5a5-9caecdfe5bd3 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:40.812185 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.wsgi [None req-a4df8524-ae05-4f5f-b5a5-9caecdfe5bd3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-a4df8524-ae05-4f5f-b5a5-9caecdfe5bd3 admin admin] Request method failure captured: Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Accept: application/json Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Accept-Encoding: gzip, deflate Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Connection: keep-alive Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Content-Length: 0 Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Host: 10.222.0.47 Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Openstack-Api-Version: compute 2.90 Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Openstack-System-Scope: None Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: User-Agent: python-novaclient Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Auth-Token: gAAAAABi4ZrQWMSC1PV0kf5ndPne-6ivEnmEEi-tl0tH9jDFZXxDCs5K2IM17-su36dR9rYiBMv9ioCFcmw_xPxW1BxKgzQn8vXhGqqyo_xwF-gxcCHTzfS8eQJRn8QpluP14t_hvL0gWmkcX_pO1zt6CrGTTIVG2PfPLNo5nMpjEFcZyD2NCzU Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Domain-Id: None Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Domain-Name: None Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Identity-Status: Confirmed Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Is-Admin-Project: True Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Domain-Id: default Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Domain-Name: Default Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Name: admin Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Role: admin,reader,member Jul 27 20:06:40.813705 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Roles: admin,reader,member Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_285f06e24b5441ccbaca698e1fbd1162", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Tenant: admin Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Tenant-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Tenant-Name: admin Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User: admin Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Domain-Id: default Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Domain-Name: Default Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Id: bf4d4f6d05b846a9b37142cd6195bb44 Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Name: admin Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: method: > Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: exception: Flavor 84 could not be found. Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: action_args: {'id': '84'} Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:06:40.815234 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:40.816179 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:40.817564 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-a4df8524-ae05-4f5f-b5a5-9caecdfe5bd3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:06:40.818789 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-a4df8524-ae05-4f5f-b5a5-9caecdfe5bd3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012162 Jul 27 20:06:40.818789 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jul 27 20:06:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 20:06:41.780278 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-f7acd5ee-8781-4632-8191-da64513ea167 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:41.781295 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-f7acd5ee-8781-4632-8191-da64513ea167 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 27 20:06:41.781683 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:42.295317 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-04600433-b766-477a-927a-e7700ea14f89 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:42.300996 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.wsgi [None req-04600433-b766-477a-927a-e7700ea14f89 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-04600433-b766-477a-927a-e7700ea14f89 admin admin] Request method failure captured: Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Accept: application/json Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Accept-Encoding: gzip, deflate Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Connection: keep-alive Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Content-Length: 0 Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Host: 10.222.0.47 Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Openstack-Api-Version: compute 2.90 Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Openstack-System-Scope: None Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: User-Agent: python-novaclient Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Auth-Token: gAAAAABi4ZrRgRP4ynGvUHfMnRnP0-JQOTwvlczoso43SKs7YuBKTXJir0dzz3CZTOaasoKCZbq58_VVgzMdCjEsaD46YZhO6xPr5Vjmh4sif-IWmcqf5dJRJCrvmO6aGBdzoUQyEZlYN2JkwbD101Ruu0EEDmvQVUQ8s4p3H9E8vvMbqVOkEEA Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Domain-Id: None Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Domain-Name: None Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Identity-Status: Confirmed Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Is-Admin-Project: True Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Domain-Id: default Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Domain-Name: Default Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Project-Name: admin Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Role: admin,reader,member Jul 27 20:06:42.302490 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Roles: admin,reader,member Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_285f06e24b5441ccbaca698e1fbd1162", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Tenant: admin Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Tenant-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-Tenant-Name: admin Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User: admin Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Domain-Id: default Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Domain-Name: Default Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Id: bf4d4f6d05b846a9b37142cd6195bb44 Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: X-User-Name: admin Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: method: > Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: exception: Flavor 451 could not be found. Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: action_args: {'id': '451'} Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:06:42.304007 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:42.304998 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.306980 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-04600433-b766-477a-927a-e7700ea14f89 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:06:42.308246 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-04600433-b766-477a-927a-e7700ea14f89 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.385976 Jul 27 20:06:42.308246 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 20:06:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:06:42.313974 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-1e9b4308-e859-4d09-8589-f6a6ab721949 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:42.328632 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-1e9b4308-e859-4d09-8589-f6a6ab721949 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018150 Jul 27 20:06:42.329385 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 20:06:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:06:42.338561 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:42.353939 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018988 Jul 27 20:06:42.354463 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 20:06:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:06:42.363969 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-c693cf2e-c3f1-47c3-82db-bede7089ef51 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:42.369888 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.wsgi [None req-c693cf2e-c3f1-47c3-82db-bede7089ef51 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-c693cf2e-c3f1-47c3-82db-bede7089ef51 admin admin] Request method failure captured: Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Accept: application/json Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Accept-Encoding: gzip, deflate Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Connection: keep-alive Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Content-Length: 0 Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Host: 10.222.0.47 Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Openstack-Api-Version: compute 2.90 Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Openstack-System-Scope: None Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: User-Agent: python-novaclient Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Auth-Token: gAAAAABi4ZrRgRP4ynGvUHfMnRnP0-JQOTwvlczoso43SKs7YuBKTXJir0dzz3CZTOaasoKCZbq58_VVgzMdCjEsaD46YZhO6xPr5Vjmh4sif-IWmcqf5dJRJCrvmO6aGBdzoUQyEZlYN2JkwbD101Ruu0EEDmvQVUQ8s4p3H9E8vvMbqVOkEEA Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Domain-Id: None Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Domain-Name: None Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Identity-Status: Confirmed Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Is-Admin-Project: True Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Domain-Id: default Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Domain-Name: Default Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Project-Name: admin Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Role: admin,reader,member Jul 27 20:06:42.371380 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Roles: admin,reader,member Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/285f06e24b5441ccbaca698e1fbd1162"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_285f06e24b5441ccbaca698e1fbd1162", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Tenant: admin Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Tenant-Id: 285f06e24b5441ccbaca698e1fbd1162 Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-Tenant-Name: admin Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User: admin Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Domain-Id: default Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Domain-Name: Default Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Id: bf4d4f6d05b846a9b37142cd6195bb44 Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: X-User-Name: admin Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: method: > Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: exception: Flavor 451 could not be found. Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: action_args: {'id': '451'} Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:06:42.373056 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:42.374155 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 20:06:42.375263 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-c693cf2e-c3f1-47c3-82db-bede7089ef51 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103734) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:06:42.376234 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-c693cf2e-c3f1-47c3-82db-bede7089ef51 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012574 Jul 27 20:06:42.376234 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 20:06:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:06:43.340083 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:43.341561 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 27 20:06:43.341561 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:43.861047 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-ff72a8a7-c6a8-495d-b103-5c72e431df30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:43.960062 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-ff72a8a7-c6a8-495d-b103-5c72e431df30 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.479532 Jul 27 20:06:43.960645 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jul 27 20:06:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:44.920977 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:44.921996 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 27 20:06:44.922390 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:45.440090 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-387ec7a4-120c-4bf5-a992-a6329c77461c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:45.514196 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-387ec7a4-120c-4bf5-a992-a6329c77461c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.453032 Jul 27 20:06:45.514752 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jul 27 20:06:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:46.483631 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:46.484723 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 27 20:06:46.485120 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:47.011918 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-65d1d1ea-e9f2-4d48-9b1a-dabd6a5a375a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:47.100761 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-65d1d1ea-e9f2-4d48-9b1a-dabd6a5a375a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.476354 Jul 27 20:06:47.101238 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jul 27 20:06:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:48.065496 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:48.066488 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 27 20:06:48.066872 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:48.582813 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-2695bf66-81ad-42a9-a485-d55f88416b94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:06:48.665479 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-2695bf66-81ad-42a9-a485-d55f88416b94 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.461429 Jul 27 20:06:48.666028 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jul 27 20:06:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:49.639865 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:49.640949 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 27 20:06:49.641340 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:50.165365 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-d995666b-d983-4e28-b54f-ca40eeffdcea admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:50.186224 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-d995666b-d983-4e28-b54f-ca40eeffdcea admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406107 Jul 27 20:06:50.186709 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Wed Jul 27 20:06:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:07:41.285567 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:07:41.286584 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0e1788d2-8f82-4f4a-87b3-58a837c4c1db admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 27 20:07:41.287004 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 20:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:07:41.297395 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:07:41.674965 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-347496b5-ef47-46d5-9d06-31916e952f4b admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:07:41.695620 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-347496b5-ef47-46d5-9d06-31916e952f4b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402628 Jul 27 20:07:41.696301 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jul 27 20:07:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:07:41.719350 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-145381cf-62bc-4f5a-94ff-d11c3823567c admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:07:41.722805 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:07:41.727687 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-145381cf-62bc-4f5a-94ff-d11c3823567c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011898 Jul 27 20:07:41.728188 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Wed Jul 27 20:07:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:07:41.739884 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8ada2e99-c98e-4aeb-a89a-711c4eddb579 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:07:41.747456 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-8ada2e99-c98e-4aeb-a89a-711c4eddb579 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011301 Jul 27 20:07:41.747970 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Wed Jul 27 20:07:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:07:41.760539 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:07:41.767986 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012503 Jul 27 20:07:41.768527 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Wed Jul 27 20:07:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:07:41.780198 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-efd8e972-000b-4427-8b6b-6cafb0e69956 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:07:41.787687 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-efd8e972-000b-4427-8b6b-6cafb0e69956 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010897 Jul 27 20:07:41.788201 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Wed Jul 27 20:07:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:11:13.989471 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:13.990503 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 27 20:11:13.990891 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:11:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:14.130662 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_api:SELECT=6 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:14.293816 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-1391ae67-89ad-42c3-846d-a0e0f2d9818a admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:14.296220 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:11:14.296220 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: warnings.warn(msg) Jul 27 20:11:14.297484 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-1391ae67-89ad-42c3-846d-a0e0f2d9818a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:14.297929 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-1391ae67-89ad-42c3-846d-a0e0f2d9818a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:14.298718 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-1391ae67-89ad-42c3-846d-a0e0f2d9818a admin admin] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:14.299146 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-1391ae67-89ad-42c3-846d-a0e0f2d9818a admin admin] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:14.332894 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-1391ae67-89ad-42c3-846d-a0e0f2d9818a admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203632 Jul 27 20:11:14.333464 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 20:11:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:11:15.146540 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:15.147586 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 27 20:11:15.147969 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:11:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:15.341540 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-654f6d18-b44d-4ce8-a156-1c760514c63b admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:15.345432 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:11:15.345432 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: warnings.warn(msg) Jul 27 20:11:15.346670 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-654f6d18-b44d-4ce8-a156-1c760514c63b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:15.347260 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-654f6d18-b44d-4ce8-a156-1c760514c63b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:15.349023 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-654f6d18-b44d-4ce8-a156-1c760514c63b admin admin] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:15.349637 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-654f6d18-b44d-4ce8-a156-1c760514c63b admin admin] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:15.370598 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-654f6d18-b44d-4ce8-a156-1c760514c63b admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083887 Jul 27 20:11:15.371098 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 20:11:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:11:26.610232 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:26.611222 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 27 20:11:26.611608 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:26.754011 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_cell0:SELECT=4 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:26.754769 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_cell1:SELECT=4 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:26.755388 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_api:SELECT=8 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:26.805504 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-1b509b21-8704-4d91-9d03-8629ae221af1 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:26.807906 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:11:26.807906 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: warnings.warn(msg) Jul 27 20:11:26.809212 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-1b509b21-8704-4d91-9d03-8629ae221af1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:26.809667 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-1b509b21-8704-4d91-9d03-8629ae221af1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:26.810543 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-1b509b21-8704-4d91-9d03-8629ae221af1 admin admin] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:26.810967 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-1b509b21-8704-4d91-9d03-8629ae221af1 admin admin] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:26.835554 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-1b509b21-8704-4d91-9d03-8629ae221af1 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085901 Jul 27 20:11:26.836097 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 20:11:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:11:27.662283 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:27.663293 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-da756fca-4170-4fea-92d8-a55e7fc8d958 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 27 20:11:27.663684 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 20:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:27.856045 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-b65e8a1c-de71-427e-b7b5-8eca62835c84 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:27.858463 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:11:27.858463 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: warnings.warn(msg) Jul 27 20:11:27.859636 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-b65e8a1c-de71-427e-b7b5-8eca62835c84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:27.860075 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-b65e8a1c-de71-427e-b7b5-8eca62835c84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:27.860886 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-b65e8a1c-de71-427e-b7b5-8eca62835c84 admin admin] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:27.861427 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-b65e8a1c-de71-427e-b7b5-8eca62835c84 admin admin] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:27.883467 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-b65e8a1c-de71-427e-b7b5-8eca62835c84 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080025 Jul 27 20:11:27.883955 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 20:11:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:24.064422 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: Wed Jul 27 20:12:24 2022 - graceful shutdown triggered... Jul 27 20:12:24.064153 dv-cinder-851249-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 20:12:24.068324 dv-cinder-851249-1-iscsi devstack@n-api.service[103734]: Gracefully killing worker 1 (pid: 103734)... Jul 27 20:12:24.068872 dv-cinder-851249-1-iscsi devstack@n-api.service[103735]: Gracefully killing worker 2 (pid: 103735)... Jul 27 20:12:25.064601 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: worker 1 buried after 1 seconds Jul 27 20:12:25.064601 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: worker 2 buried after 1 seconds Jul 27 20:12:25.064601 dv-cinder-851249-1-iscsi devstack@n-api.service[103733]: goodbye to uWSGI. Jul 27 20:12:25.066451 dv-cinder-851249-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 20:12:25.067007 dv-cinder-851249-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 20:12:25.070006 dv-cinder-851249-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 20:12:25.080087 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 20:12:25.082766 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 20:12:25 2022] *** Jul 27 20:12:25.083086 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 20:12:25.083235 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 20:12:25.083352 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: nodename: dv-cinder-851249-1-iscsi Jul 27 20:12:25.083470 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: machine: x86_64 Jul 27 20:12:25.083582 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: clock source: unix Jul 27 20:12:25.083698 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: pcre jit disabled Jul 27 20:12:25.083806 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: detected number of CPU cores: 4 Jul 27 20:12:25.083912 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: current working directory: / Jul 27 20:12:25.084029 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: detected binary path: /usr/bin/uwsgi-core Jul 27 20:12:25.084144 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: your processes number limit is 47680 Jul 27 20:12:25.084253 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: your memory page size is 4096 bytes Jul 27 20:12:25.084361 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: detected max file descriptor number: 2048 Jul 27 20:12:25.084547 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: lock engine: pthread robust mutexes Jul 27 20:12:25.084831 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: thunder lock: enabled Jul 27 20:12:25.085128 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 20:12:25.085337 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 20:12:25.128404 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: Python main interpreter initialized at 0x558033a449c0 Jul 27 20:12:25.128404 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: python threads support enabled Jul 27 20:12:25.128404 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: your server socket listen backlog is limited to 100 connections Jul 27 20:12:25.128404 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: your mercy for graceful operations on workers is 90 seconds Jul 27 20:12:25.128865 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 20:12:25.128865 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: *** Operational MODE: preforking *** Jul 27 20:12:25.129135 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: *** uWSGI is running in multiple interpreter mode *** Jul 27 20:12:25.129135 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: spawned uWSGI master process (pid: 118251) Jul 27 20:12:25.129343 dv-cinder-851249-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 20:12:25.129911 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: spawned uWSGI worker 1 (pid: 118273, cores: 1) Jul 27 20:12:25.130267 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: spawned uWSGI worker 2 (pid: 118274, cores: 1) Jul 27 20:12:25.133040 dv-cinder-851249-1-iscsi devstack@n-api.service[118251]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 20:12:25.788711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 20:12:25.790601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 20:12:26.946681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:12:26.946681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: from cryptography.utils import int_from_bytes Jul 27 20:12:26.947320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:12:26.947320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: from cryptography.utils import int_from_bytes Jul 27 20:12:26.952861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:12:26.952861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: from cryptography.utils import int_from_bytes Jul 27 20:12:26.953338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:12:26.953338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: from cryptography.utils import int_from_bytes Jul 27 20:12:29.400337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 20:12:29.400337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 20:12:29.401059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 20:12:29.401403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 20:12:29.401494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 20:12:29.401576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 20:12:29.401576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 20:12:29.401762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 20:12:29.401877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.401970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 20:12:29.402050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 20:12:29.402200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.402948 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403573 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-1-iscsi {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.403902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-1-iscsi {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.406064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.406319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.406551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.406551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.406992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.407203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.407422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.407640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.407867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.408122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.408340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.408566 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.408804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.408804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.409284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.409284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.409739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.409963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.410172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.410393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.410602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.410818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.411037 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.411228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.411423 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.411625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.411773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.411915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.412098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.412242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.412479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.412635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.412826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.412826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.413135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-1-iscsi {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.413292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.413437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.413437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.413761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-1-iscsi {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.413920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.414102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.414102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.414385 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.414529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.414681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.414681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.415920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.416079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.416551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.416788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.416960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.417115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.417272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.417919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.418072 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.418219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.418374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.418534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.418686 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.418841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.418990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.420507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.420686 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.420867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.421016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.421189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.421337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.421488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.421644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.422074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.422232 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.422391 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.422545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.422698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.422856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.423054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.423232 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.423388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.423541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.424129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.424451 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.424615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.424777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.424929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.425074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.425322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.426282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.426470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.426628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.426775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.426929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.427095 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.427289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.428512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.436298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.436574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.436702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.436783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.436864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.436945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437295 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437373 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.437933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.438345 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.438509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.438689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.438847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.439000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.439152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.439301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.439452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.439604 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.439755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.439906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.440060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.440214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.440373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.440599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.440744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.440898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.441042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.441195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.441348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.441493 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.441739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.441898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.442113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.442284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.442441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.442601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.442774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.442938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.443081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.443236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.443389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.443541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.443684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.443826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.443969 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.444129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.444293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.444462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.444623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.444768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.444953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.445118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.445263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.445417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.445567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.445729 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.445915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.446102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.447541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.447703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.447847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.447990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.448141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.448295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.448481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.448639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.448784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.448935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.449078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.449236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.449388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.449553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.449719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.449865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.450022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.450174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.450460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.450606 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.450749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.450894 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.451052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.451196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.451338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.451488 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.451639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.451795 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.451948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.452091 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.452241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.452422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.452584 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.452736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.452889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.453044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.453196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.453380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.453525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.453679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.453836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.453981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.454124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.454274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.454274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.454555 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.454555 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.454838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.454838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.455121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.455274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.455432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.455595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.455745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.455896 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.456048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.456192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.456349 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.457043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.457211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.457377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.457625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.457775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.458013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.458160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.458374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.458789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.458950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.459103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.459258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.459258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.459542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.459693 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.459844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.460005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.460150 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.460300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.460481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.460707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.460858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.461015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.461159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.461301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.461444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.461586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.461739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.465166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.465350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.465503 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.465650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:29.465650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.465938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.466094 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.466248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.466438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.466596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.467282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.467548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.467824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.467945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.468069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.468181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.468300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.475147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.475314 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.475467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.475611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.475798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.475949 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.476113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.476257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.476446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.476598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.476742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.476930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.477553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.477709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.477989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.478157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.478347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.478498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.478651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.478796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.478999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.479286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.482575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.482744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.482910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.483074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.483222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.483369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.483513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.483657 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.483816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.483970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.484158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.484313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.484484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.484640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.484795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.484940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.485103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.485247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.485396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.485550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.485695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.485851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.486010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.486199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.486350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.486582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.486734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.486886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.487041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.487210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.487889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.488177 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.488339 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.488526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.488673 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.488827 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.488979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.489134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.489312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.489595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.489869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.490055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.490246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.490408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.490553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.490753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.490905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.491056 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.491213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.491365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.491515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.491658 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.491808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.491951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.492113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.492257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.492441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.492677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.492839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.492983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.493135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.493279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.493422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.493565 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.493708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.494104 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.494262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.494568 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.494722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.494866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.495022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.495186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.495331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.495630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.496290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.496456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.496606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.496777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.496930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.497075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.497237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.497390 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.497988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.498257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.498444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.498630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.498810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.498954 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.499107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.499261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.499414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.499695 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.499868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.500028 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.500190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.500353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.500547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.500699 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.500901 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.501060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.501222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.501374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.501522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.501740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.501929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.502104 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.502345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.502532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.502775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.502941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.503108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.503266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.503429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.503580 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.503738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.503889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.504078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.504244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.504431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.504601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.504761 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.504911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.505061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.505220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.505381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.505538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.505697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.505847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.506039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.506209 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.506381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.506543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.506701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.506891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.507041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.507201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.507351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.507500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.508156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.508343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.508644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.508812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.508971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.509193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.509352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.509502 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.509667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.509667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.510068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.510261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.510261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.510602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.510769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.510769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.511084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.511288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.511288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.511602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.511763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.511913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.512069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.512218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.512427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.512603 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.512774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.513002 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.513164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.513164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.513508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.513687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.513840 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.513989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.513989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.514279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.514435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.514435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.514752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.514965 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.514965 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.515445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.515618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.515785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.515957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.516116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.516273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.516484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.516651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.516801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.516952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.517101 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.517257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.517415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.517615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.518182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.518376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.518537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.518811 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.518977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.519143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.519294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.519443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.519632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.519801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.519975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.520229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.520410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.520568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.520568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.520877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.521037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.521037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.521037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.521483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.521642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.521642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.521942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.522099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.522250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.522399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.522399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.522704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.522868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.523127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.523291 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.523449 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.523608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.523806 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.523976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.524127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.524278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.524460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.524631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.524782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.524951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.525101 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.525250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.525399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.525548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.525706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.525863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.526020 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.526193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.526434 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.526591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.526806 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.526971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.527143 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.527293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.527443 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.527591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.527755 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.527966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.528550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.528704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.528962 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.529120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.529281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.529431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.529592 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.529749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.529907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.530072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.530241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.530486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.530486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.530785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.530943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.531107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.531257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.531406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.531554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.531714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.531913 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.532084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.532235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.532419 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.532587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.532746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.532896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.533733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.533896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.534064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.534236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.534387 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.534547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.534699 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.535151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.535396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.535550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.535700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.535851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.536052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.536209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.536375 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.536552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.536726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.536878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.537034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.537200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.537358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.537508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.537664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.537821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.537821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.538627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.538809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.538982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.539256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.539433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.539585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.539744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.539894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.540050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.540050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.540342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.540342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.540815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.540977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.541135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.541284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.541442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.541610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.541846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.542015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.542168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.542832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.542992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.543159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.543319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.543477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.543628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.543886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.544090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.544274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.544444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.544612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.544762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.544911 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.545079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.545239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.545398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.545566 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.545730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.545881 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.546040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.546198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.546621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.546775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.546775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.546775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.546775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.547361 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.547511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.548290 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.548570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.548846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.549005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.549156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.549418 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.549605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.549767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.549918 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.550068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.550227 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.550378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.550542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.550713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.550999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.551193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.551193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.551193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.551193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.551786 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.551936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.551936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.552264 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.552444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.552617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.552769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.552769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.553052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.553201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.553365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.553517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.553676 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.553834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.554086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.554252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.554252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.554252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.554252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.554832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.555002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.555196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.555363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.555515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.555664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.555831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.555982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.556132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.556294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.556499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.556663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.556829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.556980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.557129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.557286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.557286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.557286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.557286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.557876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.558795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.558975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.559126 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.559276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.559458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.559707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.559872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.560024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.560224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.560415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.560585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.560737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.560908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.561170 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.561329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.561535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.561688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.561837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.561996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.562147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.562306 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.562471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.562622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.562780 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.562950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.563101 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.563252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.563412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.563571 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.563721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.563871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.564020 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.564526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.564689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.564848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.565000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.565163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.565325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.565486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.565637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.565786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.565786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.566071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.566223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.566382 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.566531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.566680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.566830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.566979 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.567129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.568320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.568524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.568691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.568878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.569043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.569205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.569358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.569508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.569656 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.569921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.570079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.570316 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.570479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.570643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.570793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.570950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.571100 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.571487 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.571667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.571820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.571978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.572130 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.572287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.572526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.572685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.572856 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.573015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.573165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.573329 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.573524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.573726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.573888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.574038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.574195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.574447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.574641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.574804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.574962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.575143 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.575296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.575454 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.575612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.575763 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.575912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.576203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.576356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.584968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.585062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.585238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.585327 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.585437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.585524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.585646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.585745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.585841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.585946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.586936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587116 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.587915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588188 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.588943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.589045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.589045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.589391 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.589478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.589569 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.589665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.589751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.589854 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.589951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590612 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.590977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.591993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.592947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593375 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.593920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.594913 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595175 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595436 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595528 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.595973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.596058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.596457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.596608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.596608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.596776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.596871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.596964 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597419 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.597972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598520 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.598984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.599983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.600949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601487 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601571 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601859 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.601947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602139 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602139 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602467 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.602924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.603944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.604027 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.604109 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.604202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.604288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.604407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.604496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.604582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.604665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.604768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.605377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.605473 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.605567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.605659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.605744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.605841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.605935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606290 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606542 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606720 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.606908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.607978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608426 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608603 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608685 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.608963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609146 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.609917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.610954 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611672 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.611981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612170 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612264 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612887 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.612979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613772 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.613960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614128 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614658 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.614933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615026 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615539 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.615982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.616888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.617498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.617498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.617498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.617498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.617498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.617498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.617498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.618747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.619775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.619775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.619775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.619775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.619775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.619775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.619775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.619775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.621884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.622525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.622525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.622525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.622525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.622525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.622525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.622525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.622525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.623760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.624252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.624252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.624252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.624252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.624252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.624252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.624252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.624252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625791 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.625974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626414 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.626980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.627063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.627063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.627459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.627546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.627678 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.627774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.627873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.627959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.628930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629443 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.629915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.630959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631329 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631699 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.631946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.632036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.632036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.632173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.632270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.632355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.632458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.632577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.644976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.645122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.645215 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.645446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.645563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.645655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.645740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.645836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.645920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646458 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.646940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.647929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.648924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.649936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650087 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650536 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650609 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.650869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.651010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.651080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.651159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.651231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.651301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.651420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.651498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.651568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.651647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.652961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653598 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.653975 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654056 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.654976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655584 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.655878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656875 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.656999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657411 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657676 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.657940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658109 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658562 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.658969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659141 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.659991 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 20:12:29.660237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.660917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.661177 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.662709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.662709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.663326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.663459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.663790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.664422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.664822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.665155 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.665500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.665844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.666162 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.666479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.666793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.667129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.667989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.668315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.668677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.669003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.669324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.673621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.673621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.673621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.673621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.673621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.673621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.673621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.673621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.674287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.674287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.674287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.674287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.674287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.674287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.674287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.674866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.674866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.675036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.675228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.675550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.675884 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.676206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.676546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.676981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.677302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.677630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.677956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.678273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.678602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.678972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.679294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.679621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.679939 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.680280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.680653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.680994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.681345 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.681638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.681953 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.682273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.682591 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.682937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.683841 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.684052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.684361 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.684701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.685137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.685368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.685682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.685994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.686307 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.686614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.686923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.687251 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.687541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.687851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.688160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.688497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.688807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.689118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.689425 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.689736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.690183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.690460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.690755 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.691081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.691483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.691723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.692051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.692368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.696594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.696594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.696594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.696594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.696594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.696594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.696594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.696594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.697322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.697322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.697322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.697322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.697322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.697322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.697322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.698025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.698025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.698025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.698373 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.699354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.699676 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.699997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.700318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.700667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.700983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.701307 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.701629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.702004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.702312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.702638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.703006 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.703340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.703661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.703998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.704333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.704714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.705036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.705390 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.705724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.706046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.706366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.706679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:29.706926 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 20:12:29.721795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO dbcounter [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Registered counter for database nova_api Jul 27 20:12:29.742609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_db.sqlalchemy.engines [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:29.750046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writer thread running {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:29.769679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO dbcounter [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Registered counter for database nova_api Jul 27 20:12:29.790497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_db.sqlalchemy.engines [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:29.797519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writer thread running {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:29.805778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.context [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),deef0dc2-6aba-4ad7-810e-4420c759a7c1(cell1) {{(pid=118274) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 20:12:29.810437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:29.812014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:29.812850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:29.814950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:29.816967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO dbcounter [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Registered counter for database nova_cell0 Jul 27 20:12:29.821066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO dbcounter [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Registered counter for database nova_cell1 Jul 27 20:12:29.829712 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_db.sqlalchemy.engines [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:29.830506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_db.sqlalchemy.engines [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:29.836766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writer thread running {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:29.838081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writer thread running {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:29.853686 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.context [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),deef0dc2-6aba-4ad7-810e-4420c759a7c1(cell1) {{(pid=118273) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 20:12:29.857839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:29.859421 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:29.860222 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:29.862362 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:29.864336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO dbcounter [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Registered counter for database nova_cell0 Jul 27 20:12:29.868338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO dbcounter [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Registered counter for database nova_cell1 Jul 27 20:12:29.876535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_db.sqlalchemy.engines [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:29.878777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_db.sqlalchemy.engines [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:29.883828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writer thread running {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:29.887084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writer thread running {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:29.984204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO dbcounter [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Registered counter for database nova_cell0 Jul 27 20:12:29.994834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_db.sqlalchemy.engines [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:30.000002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writer thread running {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:30.033014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO dbcounter [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Registered counter for database nova_cell0 Jul 27 20:12:30.039741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_db.sqlalchemy.engines [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:30.044948 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writer thread running {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:30.320454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: WARNING keystonemiddleware.auth_token [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:12:30.327816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: WARNING keystonemiddleware.auth_token [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:12:30.364272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: WARNING keystonemiddleware.auth_token [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:12:30.372731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: WARNING keystonemiddleware.auth_token [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:12:30.670819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: WARNING keystonemiddleware.auth_token [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:12:30.676818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: WARNING keystonemiddleware.auth_token [None req-30835e0a-ee07-4397-bcb9-851e0cebf076 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:12:30.682190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558033a449c0 pid: 118274 (default app) Jul 27 20:12:30.715801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: WARNING keystonemiddleware.auth_token [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:12:30.721931 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: WARNING keystonemiddleware.auth_token [None req-c9c10aec-8208-4f0a-8174-6f01574ca5e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:12:30.727359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558033a449c0 pid: 118273 (default app) Jul 27 20:13:12.223953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:12.225129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:12.226195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:12.227260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:13.284968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:13.285776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:13.286736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:13.287646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:13.522500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-443c6305-72cf-46a7-a5f4-676324e1dd32 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Action: 'create', calling method: .version_select at 0x7f35cc448ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-871784362"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:14.265508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-39795bab-9fd5-457e-b4f3-677ac942030c tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Action: 'create', calling method: .version_select at 0x7f35cc448d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-977373514", "metadata": {"Type": "work"}}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:15.679563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-443c6305-72cf-46a7-a5f4-676324e1dd32 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.466435 Jul 27 20:13:15.681285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Wed Jul 27 20:13:12 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3470 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 20:13:15.744734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-39795bab-9fd5-457e-b4f3-677ac942030c tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.468153 Jul 27 20:13:15.748437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1/2] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Jul 27 20:13:13 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2471 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 27 20:13:15.756243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-84cc1fd7-3cd3-4e12-b1db-ecc8c0a90b6b tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2a2b80>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:15.861576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-84cc1fd7-3cd3-4e12-b1db-ecc8c0a90b6b tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31" status: 200 len: 344 microversion: 2.1 time: 0.111025 Jul 27 20:13:15.861975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:15 2022] GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 => generated 344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:15.867446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b05ce367-4e45-4944-9217-3e097b1865f4 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Calling method '.version_select at 0x7f35cc2b7310>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:15.954427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b05ce367-4e45-4944-9217-3e097b1865f4 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636" status: 200 len: 352 microversion: 2.1 time: 0.091041 Jul 27 20:13:15.955592 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 3/4] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:15 2022] GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:16.203989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-14669f21-f96c-4611-a8ec-5cd08a3c1c8b tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Action: 'create', calling method: .version_select at 0x7f35cc2a2a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-244469703", "metadata": {"Type": "work"}}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-14669f21-f96c-4611-a8ec-5cd08a3c1c8b tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Request method failure captured: Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 121 Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxZF9bupC-wLocqrjUOZsnsZutCuSM_c5Vd4Fx_bMjDJIfl4njFxeEQBfVgcRXbe0aDkBZRZvHbI1d69cMcGGWKfRUC1hsjg0_bGZI8UcoMSwuddGIqTllU78Kb7vuqRmPpFiB-8RabZbI6P9FcZGynKMkDRxR0JTi_W4sfiWRW2Dk Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:13:16.215210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4ae4977eae84450dbb1fae0a76b7d711", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: a2026010ec9b4029883b51c4d5059511 Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-244469703", "metadata": {"Type": "work"}}} Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: Jul 27 20:13:16.220425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-244469703', 'metadata': {'Type': 'work'}}}} Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise error Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi '#$%' Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:16.221450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 20:13:16.223067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 20:13:16.224661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 20:13:16.224661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.224661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-14669f21-f96c-4611-a8ec-5cd08a3c1c8b tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:16.224661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-14669f21-f96c-4611-a8ec-5cd08a3c1c8b tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.533512 Jul 27 20:13:16.224661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 2/5] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Jul 27 20:13:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 540 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:13:16.233559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7104b4a6-58c2-40c5-b13c-0c5411261c67 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Action: 'create', calling method: .version_select at 0x7f35cc2b7940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1508400984", "metadata": {"Type": "work"}}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7104b4a6-58c2-40c5-b13c-0c5411261c67 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Request method failure captured: Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 120 Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxZF9bupC-wLocqrjUOZsnsZutCuSM_c5Vd4Fx_bMjDJIfl4njFxeEQBfVgcRXbe0aDkBZRZvHbI1d69cMcGGWKfRUC1hsjg0_bGZI8UcoMSwuddGIqTllU78Kb7vuqRmPpFiB-8RabZbI6P9FcZGynKMkDRxR0JTi_W4sfiWRW2Dk Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:13:16.261250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4ae4977eae84450dbb1fae0a76b7d711", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: a2026010ec9b4029883b51c4d5059511 Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1508400984", "metadata": {"Type": "work"}}} Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: Jul 27 20:13:16.262816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1508400984', 'metadata': {'Type': 'work'}}}} Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise error Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi '0' Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:16.263740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 20:13:16.265347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 20:13:16.267573 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 20:13:16.267573 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.270904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7104b4a6-58c2-40c5-b13c-0c5411261c67 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:16.274741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7104b4a6-58c2-40c5-b13c-0c5411261c67 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.044857 Jul 27 20:13:16.277683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 4/6] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Jul 27 20:13:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:13:16.287167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7151a524-8e5b-4b00-9e2c-898d71199749 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Action: 'create', calling method: .version_select at 0x7f35cc270430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1467420255", "metadata": {"Type": "work"}}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7151a524-8e5b-4b00-9e2c-898d71199749 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Request method failure captured: Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 119 Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxZF9bupC-wLocqrjUOZsnsZutCuSM_c5Vd4Fx_bMjDJIfl4njFxeEQBfVgcRXbe0aDkBZRZvHbI1d69cMcGGWKfRUC1hsjg0_bGZI8UcoMSwuddGIqTllU78Kb7vuqRmPpFiB-8RabZbI6P9FcZGynKMkDRxR0JTi_W4sfiWRW2Dk Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:13:16.291796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4ae4977eae84450dbb1fae0a76b7d711", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: a2026010ec9b4029883b51c4d5059511 Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1467420255", "metadata": {"Type": "work"}}} Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: Jul 27 20:13:16.293354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1467420255', 'metadata': {'Type': 'work'}}}} Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise error Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi '' Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:16.294199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 20:13:16.295585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 20:13:16.296820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 20:13:16.296820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.296820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7151a524-8e5b-4b00-9e2c-898d71199749 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:16.296820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7151a524-8e5b-4b00-9e2c-898d71199749 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010639 Jul 27 20:13:16.296820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 3/7] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Jul 27 20:13:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:13:16.305525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f5f66d68-89af-4db8-b6ef-fc4f692f6c98 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Calling method '.version_select at 0x7f35cc2a2c10>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-f5f66d68-89af-4db8-b6ef-fc4f692f6c98 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] HTTP exception thrown: Volume tempest-invalid-1146273867 could not be found. Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f5f66d68-89af-4db8-b6ef-fc4f692f6c98 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Request method failure captured: Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1146273867 HTTP/1.1 Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxZF9bupC-wLocqrjUOZsnsZutCuSM_c5Vd4Fx_bMjDJIfl4njFxeEQBfVgcRXbe0aDkBZRZvHbI1d69cMcGGWKfRUC1hsjg0_bGZI8UcoMSwuddGIqTllU78Kb7vuqRmPpFiB-8RabZbI6P9FcZGynKMkDRxR0JTi_W4sfiWRW2Dk Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:13:16.566172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4ae4977eae84450dbb1fae0a76b7d711", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: a2026010ec9b4029883b51c4d5059511 Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Volume tempest-invalid-1146273867 could not be found. Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': 'tempest-invalid-1146273867'} Jul 27 20:13:16.597576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1146273867 could not be found. (HTTP 404) (Request-ID: req-40cad4fb-713c-478d-9266-e38d3db2f692) Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.600043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:13:16.606838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1146273867 could not be found. Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:13:16.611041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1146273867 could not be found. Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1146273867 could not be found. Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f5f66d68-89af-4db8-b6ef-fc4f692f6c98 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Returning 404 to user: Volume tempest-invalid-1146273867 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f5f66d68-89af-4db8-b6ef-fc4f692f6c98 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1146273867" status: 404 len: 99 microversion: 2.1 time: 0.057731 Jul 27 20:13:16.615992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 5/8] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Jul 27 20:13:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1146273867 => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 27 20:13:16.617207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-15776667-b09f-43ae-a65f-e5314027c5f8 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006187 Jul 27 20:13:16.617207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 4/9] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Jul 27 20:13:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 20:13:16.617405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f9d51189-87b6-4fac-8781-52127b51ddc3 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006905 Jul 27 20:13:16.617405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 6/10] 10.222.0.47 () {58 vars in 1137 bytes} [Wed Jul 27 20:13:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4abca4cb-2f5f-4696-a7ee-3271aacef33e tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Calling method '.version_select at 0x7f35cc2a2ca0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-4abca4cb-2f5f-4696-a7ee-3271aacef33e tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] HTTP exception thrown: Volume ca1c2b4d-0858-4918-9d2d-fbec3dad2304 could not be found. Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4abca4cb-2f5f-4696-a7ee-3271aacef33e tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Request method failure captured: Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/os-volumes/ca1c2b4d-0858-4918-9d2d-fbec3dad2304 HTTP/1.1 Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxZF9bupC-wLocqrjUOZsnsZutCuSM_c5Vd4Fx_bMjDJIfl4njFxeEQBfVgcRXbe0aDkBZRZvHbI1d69cMcGGWKfRUC1hsjg0_bGZI8UcoMSwuddGIqTllU78Kb7vuqRmPpFiB-8RabZbI6P9FcZGynKMkDRxR0JTi_W4sfiWRW2Dk Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:13:16.617609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4ae4977eae84450dbb1fae0a76b7d711", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: a2026010ec9b4029883b51c4d5059511 Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Volume ca1c2b4d-0858-4918-9d2d-fbec3dad2304 could not be found. Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': 'ca1c2b4d-0858-4918-9d2d-fbec3dad2304'} Jul 27 20:13:16.622229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca1c2b4d-0858-4918-9d2d-fbec3dad2304 could not be found. (HTTP 404) (Request-ID: req-b587067b-e101-417b-af1c-d059ba39e831) Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.623090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:13:16.624476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca1c2b4d-0858-4918-9d2d-fbec3dad2304 could not be found. Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 20:13:16.625793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca1c2b4d-0858-4918-9d2d-fbec3dad2304 could not be found. Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca1c2b4d-0858-4918-9d2d-fbec3dad2304 could not be found. Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4abca4cb-2f5f-4696-a7ee-3271aacef33e tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Returning 404 to user: Volume ca1c2b4d-0858-4918-9d2d-fbec3dad2304 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4abca4cb-2f5f-4696-a7ee-3271aacef33e tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/ca1c2b4d-0858-4918-9d2d-fbec3dad2304" status: 404 len: 109 microversion: 2.1 time: 0.047513 Jul 27 20:13:16.627145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 5/11] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:13:16 2022] DELETE /compute/v2.1/os-volumes/ca1c2b4d-0858-4918-9d2d-fbec3dad2304 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bda95db1-9325-4f84-9b69-b8ee801d7c59 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Calling method '.version_select at 0x7f35cc2bf1f0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-bda95db1-9325-4f84-9b69-b8ee801d7c59 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] HTTP exception thrown: Volume 394c9009-efae-4367-be49-c9a06bf75a18 could not be found. Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bda95db1-9325-4f84-9b69-b8ee801d7c59 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Request method failure captured: Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/os-volumes/394c9009-efae-4367-be49-c9a06bf75a18 HTTP/1.1 Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxZF9bupC-wLocqrjUOZsnsZutCuSM_c5Vd4Fx_bMjDJIfl4njFxeEQBfVgcRXbe0aDkBZRZvHbI1d69cMcGGWKfRUC1hsjg0_bGZI8UcoMSwuddGIqTllU78Kb7vuqRmPpFiB-8RabZbI6P9FcZGynKMkDRxR0JTi_W4sfiWRW2Dk Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:13:16.628221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4ae4977eae84450dbb1fae0a76b7d711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4ae4977eae84450dbb1fae0a76b7d711", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 4ae4977eae84450dbb1fae0a76b7d711 Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesNegativeTest-775015373 Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: a2026010ec9b4029883b51c4d5059511 Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesNegativeTest-775015373-project Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Volume 394c9009-efae-4367-be49-c9a06bf75a18 could not be found. Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '394c9009-efae-4367-be49-c9a06bf75a18'} Jul 27 20:13:16.635357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 394c9009-efae-4367-be49-c9a06bf75a18 could not be found. (HTTP 404) (Request-ID: req-ac711cbf-e778-47d0-8bbd-f170fccf208c) Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.636877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:16.639674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 394c9009-efae-4367-be49-c9a06bf75a18 could not be found. Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 20:13:16.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 394c9009-efae-4367-be49-c9a06bf75a18 could not be found. Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 394c9009-efae-4367-be49-c9a06bf75a18 could not be found. Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bda95db1-9325-4f84-9b69-b8ee801d7c59 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] Returning 404 to user: Volume 394c9009-efae-4367-be49-c9a06bf75a18 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bda95db1-9325-4f84-9b69-b8ee801d7c59 tempest-VolumesNegativeTest-775015373 tempest-VolumesNegativeTest-775015373-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/394c9009-efae-4367-be49-c9a06bf75a18" status: 404 len: 109 microversion: 2.1 time: 0.042197 Jul 27 20:13:16.644130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 7/12] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:16 2022] GET /compute/v2.1/os-volumes/394c9009-efae-4367-be49-c9a06bf75a18 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:13:16.877626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a84c5ea0-8631-44a8-b881-c0534bafc3ce tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2a2ee0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:16.972687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d25add9e-f089-4b9d-948e-2d39b3297e98 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Calling method '.version_select at 0x7f35cc2b7dc0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:17.010570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a84c5ea0-8631-44a8-b881-c0534bafc3ce tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31" status: 200 len: 344 microversion: 2.1 time: 0.137417 Jul 27 20:13:17.012132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 6/13] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:16 2022] GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:17.081065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d25add9e-f089-4b9d-948e-2d39b3297e98 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636" status: 200 len: 352 microversion: 2.1 time: 0.112185 Jul 27 20:13:17.081684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 8/14] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:16 2022] GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:13:18.025739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-82567a7b-a104-4ef1-b8f6-799e321b76b7 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2b4550>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:18.095459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bbfd9fb3-f6e9-471c-89ad-268704cd574f tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Calling method '.version_select at 0x7f35cc2bf550>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:18.142736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-82567a7b-a104-4ef1-b8f6-799e321b76b7 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31" status: 200 len: 345 microversion: 2.1 time: 0.121009 Jul 27 20:13:18.154483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 7/15] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:18 2022] GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:18.159752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-23ae273f-a392-4420-bdcb-6fa507915287 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Action: 'create', calling method: .version_select at 0x7f35cc448f70>, body: {"snapshot": {"volume_id": "031eebfe-83d5-4101-84c9-bb13c3404a31", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1549038120"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:18.222902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bbfd9fb3-f6e9-471c-89ad-268704cd574f tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636" status: 200 len: 353 microversion: 2.1 time: 0.131548 Jul 27 20:13:18.230994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 9/16] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:18 2022] GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:18.236193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d9b6e2d4-9a82-4e5e-847f-8222f1c8f907 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Calling method '.version_select at 0x7f35cc2a2af0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:18.318837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d9b6e2d4-9a82-4e5e-847f-8222f1c8f907 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636" status: 200 len: 353 microversion: 2.1 time: 0.086653 Jul 27 20:13:18.320151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 10/17] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:18 2022] GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:18.347505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fd1a171f-1492-4f10-89d6-8b4289e43c3b tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Calling method '.version_select at 0x7f35cc2b7c10>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:18.827253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fd1a171f-1492-4f10-89d6-8b4289e43c3b tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636" status: 202 len: 0 microversion: 2.1 time: 0.484521 Jul 27 20:13:18.827253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 11/18] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:13:18 2022] DELETE /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636 => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:13:18.836211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8e3f156a-7134-445b-bc01-224e4a0724bc tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Calling method '.version_select at 0x7f35cc2b71f0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:18.997306 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-23ae273f-a392-4420-bdcb-6fa507915287 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.838524 Jul 27 20:13:18.997929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 8/19] 10.222.0.47 () {60 vars in 1162 bytes} [Wed Jul 27 20:13:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:19.008263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8e3f156a-7134-445b-bc01-224e4a0724bc tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636" status: 200 len: 352 microversion: 2.1 time: 0.176743 Jul 27 20:13:19.015463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 12/20] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:18 2022] GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636 => generated 352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:19.022055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f79df6b2-9448-49d9-a25f-bbd1fdf98a56 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2a2dc0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:19.216398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f79df6b2-9448-49d9-a25f-bbd1fdf98a56 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168" status: 200 len: 287 microversion: 2.1 time: 0.200108 Jul 27 20:13:19.223085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 13/21] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 20:13:19 2022] GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 => generated 287 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:19.230654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-93144061-cf41-4a5f-bb59-142231183887 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2229d0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:19.339374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-93144061-cf41-4a5f-bb59-142231183887 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.114995 Jul 27 20:13:19.342472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 9/22] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Jul 27 20:13:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:19.354395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-92080283-5331-42ed-8527-b3e3cabf55fb tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2bf550>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:19.408816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-92080283-5331-42ed-8527-b3e3cabf55fb tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168" status: 200 len: 287 microversion: 2.1 time: 0.061036 Jul 27 20:13:19.413396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 14/23] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 20:13:19 2022] GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:20.022237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-655c4151-001f-464e-993c-008f5a3680d2 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Calling method '.version_select at 0x7f35cc2a2dc0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:20.063581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-655c4151-001f-464e-993c-008f5a3680d2 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] HTTP exception thrown: Volume aedad591-a988-4363-88d4-90a161f60636 could not be found. Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-655c4151-001f-464e-993c-008f5a3680d2 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Request method failure captured: Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636 HTTP/1.1 Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxZ3G3cHgmy83WrVJBVHfyg0h6P0r8OUorKbdjJqu57tQ3rX9rDlEkpyCXIg3GJ6CGvcTC54HpnoNwpZ1vmVj1Hj-aYobw4ALtPyMXDxNtKmrCUQcFvutuYKFbk8H6f4af0iQBoEKRUE8YDRGtQQoZcBNrFRU2UMdpqhcZLU9IrRB8 Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 1c48ed1c9e2a4a1b840228b1313751f3 Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesGetTestJSON-961059411 Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:13:20.065611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1c48ed1c9e2a4a1b840228b1313751f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1c48ed1c9e2a4a1b840228b1313751f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1c48ed1c9e2a4a1b840228b1313751f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1c48ed1c9e2a4a1b840228b1313751f3", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesGetTestJSON-961059411 Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 1c48ed1c9e2a4a1b840228b1313751f3 Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesGetTestJSON-961059411 Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesGetTestJSON-961059411-project Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 088d9846b00944a38315bb3ac9384929 Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesGetTestJSON-961059411-project Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Volume aedad591-a988-4363-88d4-90a161f60636 could not be found. Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': 'aedad591-a988-4363-88d4-90a161f60636'} Jul 27 20:13:20.066607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aedad591-a988-4363-88d4-90a161f60636 could not be found. (HTTP 404) (Request-ID: req-6a9e4ff3-44f3-42e6-956c-c111c5143c44) Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:20.067270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:20.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aedad591-a988-4363-88d4-90a161f60636 could not be found. Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 20:13:20.069042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aedad591-a988-4363-88d4-90a161f60636 could not be found. Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aedad591-a988-4363-88d4-90a161f60636 could not be found. Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-655c4151-001f-464e-993c-008f5a3680d2 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] Returning 404 to user: Volume aedad591-a988-4363-88d4-90a161f60636 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-655c4151-001f-464e-993c-008f5a3680d2 tempest-VolumesGetTestJSON-961059411 tempest-VolumesGetTestJSON-961059411-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636" status: 404 len: 109 microversion: 2.1 time: 0.048662 Jul 27 20:13:20.069949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 10/24] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:20 2022] GET /compute/v2.1/os-volumes/aedad591-a988-4363-88d4-90a161f60636 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:13:20.425854 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e4de1faf-7e4d-46e8-b37c-b5eb3c32351d tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc221820>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:20.493509 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e4de1faf-7e4d-46e8-b37c-b5eb3c32351d tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168" status: 200 len: 287 microversion: 2.1 time: 0.071886 Jul 27 20:13:20.494904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 15/25] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 20:13:20 2022] GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:21.507446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-355d221f-0f4a-401d-9338-79f1d2b2e1a7 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2a2ee0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:21.555701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-355d221f-0f4a-401d-9338-79f1d2b2e1a7 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168" status: 200 len: 287 microversion: 2.1 time: 0.052783 Jul 27 20:13:21.556835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 11/26] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 20:13:21 2022] GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:22.569497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-64c5fdc0-c9a0-4231-9949-f9e1624d0f5e tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2bf550>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:22.637855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-64c5fdc0-c9a0-4231-9949-f9e1624d0f5e tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168" status: 200 len: 287 microversion: 2.1 time: 0.073027 Jul 27 20:13:22.640356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 16/27] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 20:13:22 2022] GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:13:23.652346 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eaa729c1-2b23-4572-a47c-2111760a5f9b tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2b4dc0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:23.715349 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eaa729c1-2b23-4572-a47c-2111760a5f9b tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168" status: 200 len: 288 microversion: 2.1 time: 0.067722 Jul 27 20:13:23.716366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 12/28] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 20:13:23 2022] GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 => generated 288 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:23.726650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-65ea0dc9-ca27-4e4a-9f80-16b242a486be tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2a2dc0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:23.939174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-65ea0dc9-ca27-4e4a-9f80-16b242a486be tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168" status: 202 len: 0 microversion: 2.1 time: 0.209103 Jul 27 20:13:23.939174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 17/29] 10.222.0.47 () {58 vars in 1254 bytes} [Wed Jul 27 20:13:23 2022] DELETE /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:13:23.941437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fcc4cb25-93b6-44a2-84e3-c1bdc48c8c1e tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc222f70>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:24.014489 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fcc4cb25-93b6-44a2-84e3-c1bdc48c8c1e tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168" status: 200 len: 287 microversion: 2.1 time: 0.077373 Jul 27 20:13:24.016282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 13/30] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 20:13:23 2022] GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:25.032117 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-178e63e7-5650-4392-a12f-45d68376c1ad tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2b7310>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:25.065279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-178e63e7-5650-4392-a12f-45d68376c1ad tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] HTTP exception thrown: Snapshot d1bc40a6-61b3-4fde-baf2-bf8683704168 could not be found. Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-178e63e7-5650-4392-a12f-45d68376c1ad tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Request method failure captured: Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 HTTP/1.1 Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxYFrDCIQe0wFni2Do-zlL5z5KFHXbejlCb2Vd-Ln4dF-XUJ4geQjtZk5bjYOFgFN2rUF-kW0Q1_ox7HfE_m_xfnXLuoui2wLc5VO7BmZIZUjWpPqz8aCQDRVDtKdiI3X2ufvVhP0YdZlWZSSFCmtTPEvA9U1sGI-REW3NPHjEEZ0c Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 480e9449f5e9458eb64fa91701d5be6c Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:13:25.069208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_480e9449f5e9458eb64fa91701d5be6c", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 480e9449f5e9458eb64fa91701d5be6c Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesSnapshotsTestJSON-150238579-project Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 6f49507b26104b318153db0cdf993740 Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesSnapshotsTestJSON-150238579-project Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Snapshot d1bc40a6-61b3-4fde-baf2-bf8683704168 could not be found. Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': 'd1bc40a6-61b3-4fde-baf2-bf8683704168'} Jul 27 20:13:25.070219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d1bc40a6-61b3-4fde-baf2-bf8683704168 could not be found. (HTTP 404) (Request-ID: req-027f1911-c594-41f9-897b-6e9f1e9c775a) Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:25.070829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:25.071629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d1bc40a6-61b3-4fde-baf2-bf8683704168 could not be found. Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 27 20:13:25.073158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d1bc40a6-61b3-4fde-baf2-bf8683704168 could not be found. Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d1bc40a6-61b3-4fde-baf2-bf8683704168 could not be found. Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-178e63e7-5650-4392-a12f-45d68376c1ad tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Returning 404 to user: Snapshot d1bc40a6-61b3-4fde-baf2-bf8683704168 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-178e63e7-5650-4392-a12f-45d68376c1ad tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168" status: 404 len: 111 microversion: 2.1 time: 0.044845 Jul 27 20:13:25.074039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 18/31] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 20:13:25 2022] GET /compute/v2.1/os-snapshots/d1bc40a6-61b3-4fde-baf2-bf8683704168 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:13:25.082156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd41b41e-bf46-415a-ab5c-6d829d58b544 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2228b0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:25.701929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd41b41e-bf46-415a-ab5c-6d829d58b544 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31" status: 202 len: 0 microversion: 2.1 time: 0.623795 Jul 27 20:13:25.702509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 14/32] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:13:25 2022] DELETE /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:13:25.722682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-771b0061-ff1f-42fa-92bc-5c4556d4b1ac tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc270160>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:25.846900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-771b0061-ff1f-42fa-92bc-5c4556d4b1ac tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31" status: 200 len: 344 microversion: 2.1 time: 0.126765 Jul 27 20:13:25.846900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 15/33] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:25 2022] GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:25.928123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1453047053", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:26.176004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] validate_networks() for [('94b1e3de-e2f1-41f2-b682-e11d443875aa', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:13:26.861344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-58b69803-2928-415e-8fae-a71b4505287a tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2228b0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:26.940166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-58b69803-2928-415e-8fae-a71b4505287a tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] HTTP exception thrown: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-58b69803-2928-415e-8fae-a71b4505287a tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Request method failure captured: Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 HTTP/1.1 Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxYFrDCIQe0wFni2Do-zlL5z5KFHXbejlCb2Vd-Ln4dF-XUJ4geQjtZk5bjYOFgFN2rUF-kW0Q1_ox7HfE_m_xfnXLuoui2wLc5VO7BmZIZUjWpPqz8aCQDRVDtKdiI3X2ufvVhP0YdZlWZSSFCmtTPEvA9U1sGI-REW3NPHjEEZ0c Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 480e9449f5e9458eb64fa91701d5be6c Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:13:26.943640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_480e9449f5e9458eb64fa91701d5be6c", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 480e9449f5e9458eb64fa91701d5be6c Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesSnapshotsTestJSON-150238579-project Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 6f49507b26104b318153db0cdf993740 Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesSnapshotsTestJSON-150238579-project Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '031eebfe-83d5-4101-84c9-bb13c3404a31'} Jul 27 20:13:26.946144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. (HTTP 404) (Request-ID: req-4f1e86d8-8aab-4f15-9499-6d95fc3f0943) Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:26.947032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:26.947902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 20:13:26.948783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-58b69803-2928-415e-8fae-a71b4505287a tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Returning 404 to user: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-58b69803-2928-415e-8fae-a71b4505287a tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31" status: 404 len: 109 microversion: 2.1 time: 0.090236 Jul 27 20:13:26.949940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 16/34] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:26 2022] GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:13:26.962153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-25e085a3-e1b0-4b8a-a237-0a2914728101 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc2b4e50>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:27.041930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-25e085a3-e1b0-4b8a-a237-0a2914728101 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] HTTP exception thrown: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-25e085a3-e1b0-4b8a-a237-0a2914728101 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Request method failure captured: Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 HTTP/1.1 Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxYFrDCIQe0wFni2Do-zlL5z5KFHXbejlCb2Vd-Ln4dF-XUJ4geQjtZk5bjYOFgFN2rUF-kW0Q1_ox7HfE_m_xfnXLuoui2wLc5VO7BmZIZUjWpPqz8aCQDRVDtKdiI3X2ufvVhP0YdZlWZSSFCmtTPEvA9U1sGI-REW3NPHjEEZ0c Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 480e9449f5e9458eb64fa91701d5be6c Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:13:27.043838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_480e9449f5e9458eb64fa91701d5be6c", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 480e9449f5e9458eb64fa91701d5be6c Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesSnapshotsTestJSON-150238579-project Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 6f49507b26104b318153db0cdf993740 Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesSnapshotsTestJSON-150238579-project Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '031eebfe-83d5-4101-84c9-bb13c3404a31'} Jul 27 20:13:27.044988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. (HTTP 404) (Request-ID: req-56b83cfc-2eab-4b00-837d-621fe66c8474) Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:27.045633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:13:27.046534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 20:13:27.047408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.050637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.053709 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-25e085a3-e1b0-4b8a-a237-0a2914728101 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Returning 404 to user: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:27.054866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-25e085a3-e1b0-4b8a-a237-0a2914728101 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31" status: 404 len: 109 microversion: 2.1 time: 0.096831 Jul 27 20:13:27.056661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 17/35] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:13:26 2022] DELETE /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 20:13:27.063912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f2c31605-bb29-4b12-98bb-05185a1c8c57 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Calling method '.version_select at 0x7f35cc270280>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:27.163454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-f2c31605-bb29-4b12-98bb-05185a1c8c57 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] HTTP exception thrown: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f2c31605-bb29-4b12-98bb-05185a1c8c57 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Request method failure captured: Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 HTTP/1.1 Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxYFrDCIQe0wFni2Do-zlL5z5KFHXbejlCb2Vd-Ln4dF-XUJ4geQjtZk5bjYOFgFN2rUF-kW0Q1_ox7HfE_m_xfnXLuoui2wLc5VO7BmZIZUjWpPqz8aCQDRVDtKdiI3X2ufvVhP0YdZlWZSSFCmtTPEvA9U1sGI-REW3NPHjEEZ0c Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 480e9449f5e9458eb64fa91701d5be6c Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:13:27.165513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/480e9449f5e9458eb64fa91701d5be6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_480e9449f5e9458eb64fa91701d5be6c", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 480e9449f5e9458eb64fa91701d5be6c Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-150238579 Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesSnapshotsTestJSON-150238579-project Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 6f49507b26104b318153db0cdf993740 Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesSnapshotsTestJSON-150238579-project Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '031eebfe-83d5-4101-84c9-bb13c3404a31'} Jul 27 20:13:27.171155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. (HTTP 404) (Request-ID: req-256d62b7-5aa6-4c74-a6e8-451b6330a55f) Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:27.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:13:27.172845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 20:13:27.173718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f2c31605-bb29-4b12-98bb-05185a1c8c57 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] Returning 404 to user: Volume 031eebfe-83d5-4101-84c9-bb13c3404a31 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f2c31605-bb29-4b12-98bb-05185a1c8c57 tempest-VolumesSnapshotsTestJSON-150238579 tempest-VolumesSnapshotsTestJSON-150238579-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31" status: 404 len: 109 microversion: 2.1 time: 0.106818 Jul 27 20:13:27.174681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 18/36] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:13:27 2022] GET /compute/v2.1/os-volumes/031eebfe-83d5-4101-84c9-bb13c3404a31 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:13:28.971325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c7b18cbd-2fe1-4e64-b7c6-37e00effb69e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Action: 'create', calling method: .version_select at 0x7f35cc2701f0>, body: {"keypair": {"name": "tempest-keypair-811947671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCa8sLGEpGI6iUkMacEE4OePp5edV1lLWvIlEIS5R2z55XUULHf/f32UzGE8fbVjLji83AA6cdChQXNx1MWPTrNgLtendv/mtqFQnwJdyqfBw6y6i4QhWYWJKJ8w16E7g=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:29.114097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-c7b18cbd-2fe1-4e64-b7c6-37e00effb69e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Getting quotas for project a56bf911ebbf4dd1ac5ed4bb07a9f7b3. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:13:29.126846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-c7b18cbd-2fe1-4e64-b7c6-37e00effb69e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Getting quotas for user 6cc262a3c3314be8a6ee620ebfa6fe85 and project a56bf911ebbf4dd1ac5ed4bb07a9f7b3. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:13:29.307818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c7b18cbd-2fe1-4e64-b7c6-37e00effb69e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.194640 Jul 27 20:13:29.309958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 19/37] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:13:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:13:29.465663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:13:29.467507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:13:29.468864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:13:29.469547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:13:29.470111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:13:29.503333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:29.503855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:29.506582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:29.506582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:29.575944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Getting quotas for project 2ff46475bc95496f93ad4ac4459d7cc5. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:13:29.589613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Getting quotas for user 77b0df6c83a84dbcb0fa5802c93dc6ae and project 2ff46475bc95496f93ad4ac4459d7cc5. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:13:29.604063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:13:29.607789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:13:29.811681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2ee421a7-1cc3-4d99-b83d-088f1f1fd918 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.710541 Jul 27 20:13:29.813312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 19/38] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:13:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 4713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 20:13:29.825656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9784f2e0-dd93-41d1-a167-3d6b7858bab8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:29.826490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9784f2e0-dd93-41d1-a167-3d6b7858bab8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:30.021664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9784f2e0-dd93-41d1-a167-3d6b7858bab8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:30.118527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9784f2e0-dd93-41d1-a167-3d6b7858bab8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1222 microversion: 2.1 time: 0.295283 Jul 27 20:13:30.121747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 20/39] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:29 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1222 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:31.002294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1311104707", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:31.179957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] validate_networks() for [('94b1e3de-e2f1-41f2-b682-e11d443875aa', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:13:31.810285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1266780534", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "networks": [{"uuid": "8cf21e71-e2bf-4e2e-9bd7-7c5c2de93cea"}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:31.932682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] validate_networks() for [('8cf21e71-e2bf-4e2e-9bd7-7c5c2de93cea', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:13:32.778679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:13:32.779187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:13:32.779686 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:13:32.780157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:13:32.780597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:13:32.797414 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:32.797883 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:32.798692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:32.801438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:32.848695 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Getting quotas for project 3448cb63d9b741a7956a5fc844820111. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:13:32.859153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Getting quotas for user 23d2938afd97422795662ec0581d4fa0 and project 3448cb63d9b741a7956a5fc844820111. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:13:32.893410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:13:32.893410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:13:33.103544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-57a4e4c7-6701-420e-b42d-ab5e68ebda19 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.364919 Jul 27 20:13:33.105896 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 20/40] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:13:33.129508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-653afb2d-3e8e-4632-8437-a646f2a407de tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:33.135338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-653afb2d-3e8e-4632-8437-a646f2a407de tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:33.147408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:13:33.150706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:13:33.150706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:13:33.150706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:13:33.150706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:13:33.202757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:33.203277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:33.204493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:33.205268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:33.249636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Getting quotas for project 2ff46475bc95496f93ad4ac4459d7cc5. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:13:33.256043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Getting quotas for user 77b0df6c83a84dbcb0fa5802c93dc6ae and project 2ff46475bc95496f93ad4ac4459d7cc5. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:13:33.273816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:13:33.277472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:13:33.304592 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-653afb2d-3e8e-4632-8437-a646f2a407de tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:33.347320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-653afb2d-3e8e-4632-8437-a646f2a407de tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1215 microversion: 2.1 time: 0.212795 Jul 27 20:13:33.348601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 21/41] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:33 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:33.500717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-52374068-6ac2-416c-9474-891eae25d62b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.503042 Jul 27 20:13:33.508522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 21/42] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:13:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:13:33.517027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eb8551e7-b3e4-4c6d-9a07-3db393fcc597 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:33.517893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eb8551e7-b3e4-4c6d-9a07-3db393fcc597 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:33.663393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb8551e7-b3e4-4c6d-9a07-3db393fcc597 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:33.673877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eb8551e7-b3e4-4c6d-9a07-3db393fcc597 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1222 microversion: 2.1 time: 0.162653 Jul 27 20:13:33.690192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 22/43] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:33 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:34.374657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e980226e-d516-4d7d-a05b-9d935bfb4988 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:34.378020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e980226e-d516-4d7d-a05b-9d935bfb4988 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:34.492641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-524407316", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddbd5946-27bf-4cbf-b681-8257de653bc1"}], "security_groups": [{"name": "tempest-securitygroup--2039292485"}], "key_name": "tempest-keypair-811947671", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:34.552353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e980226e-d516-4d7d-a05b-9d935bfb4988 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:34.565226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e980226e-d516-4d7d-a05b-9d935bfb4988 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1215 microversion: 2.1 time: 0.198364 Jul 27 20:13:34.565823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 22/44] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:34 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:34.695158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-31c51b1d-cd1f-43a2-a3d5-865b6253fe44 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:34.696569 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-31c51b1d-cd1f-43a2-a3d5-865b6253fe44 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:34.721582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] validate_networks() for [('ddbd5946-27bf-4cbf-b681-8257de653bc1', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:13:34.809504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31c51b1d-cd1f-43a2-a3d5-865b6253fe44 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:34.825627 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-31c51b1d-cd1f-43a2-a3d5-865b6253fe44 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1222 microversion: 2.1 time: 0.134278 Jul 27 20:13:34.826429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 23/45] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:34 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:35.473287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:13:35.473753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:13:35.474395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:13:35.474954 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:13:35.475530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:13:35.495994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:35.496674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:35.497202 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:35.497646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:35.557208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Getting quotas for project a56bf911ebbf4dd1ac5ed4bb07a9f7b3. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:13:35.561884 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Getting quotas for user 6cc262a3c3314be8a6ee620ebfa6fe85 and project a56bf911ebbf4dd1ac5ed4bb07a9f7b3. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:13:35.582978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:13:35.585359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:13:35.589905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d03ce13-7e85-4cf8-a5ca-16b4c5b174ed tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:35.590710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1d03ce13-7e85-4cf8-a5ca-16b4c5b174ed tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:35.690461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1d03ce13-7e85-4cf8-a5ca-16b4c5b174ed tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:35.701149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1d03ce13-7e85-4cf8-a5ca-16b4c5b174ed tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1215 microversion: 2.1 time: 0.117548 Jul 27 20:13:35.702164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 24/46] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:35 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:35.760005 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3f8a896f-1db7-4dd9-8f35-6cafc7d8d967 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.269577 Jul 27 20:13:35.761105 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:13:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:13:35.772480 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3784b933-ab54-42dd-96b9-7fbb6bd21e96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:35.773192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3784b933-ab54-42dd-96b9-7fbb6bd21e96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:35.850092 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b794d0a6-97f7-41b5-97e7-e0add29b614c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:35.850690 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b794d0a6-97f7-41b5-97e7-e0add29b614c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:35.859934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3784b933-ab54-42dd-96b9-7fbb6bd21e96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:35.862475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b794d0a6-97f7-41b5-97e7-e0add29b614c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:35.863118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b794d0a6-97f7-41b5-97e7-e0add29b614c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:35.865596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b794d0a6-97f7-41b5-97e7-e0add29b614c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:35.867292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b794d0a6-97f7-41b5-97e7-e0add29b614c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:35.873051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3784b933-ab54-42dd-96b9-7fbb6bd21e96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1236 microversion: 2.1 time: 0.104573 Jul 27 20:13:35.874217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 25/48] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:35 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:36.165608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b794d0a6-97f7-41b5-97e7-e0add29b614c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:36.200706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b794d0a6-97f7-41b5-97e7-e0add29b614c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1218 microversion: 2.1 time: 0.355587 Jul 27 20:13:36.203429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 24/49] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:35 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1218 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:36.724513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-19b825f9-d1eb-4506-9eee-0ea349520e21 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:36.726452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-19b825f9-d1eb-4506-9eee-0ea349520e21 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:36.746290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19b825f9-d1eb-4506-9eee-0ea349520e21 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:36.749323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19b825f9-d1eb-4506-9eee-0ea349520e21 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:36.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19b825f9-d1eb-4506-9eee-0ea349520e21 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:36.753144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19b825f9-d1eb-4506-9eee-0ea349520e21 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:36.895993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1ab6df4f-6146-493a-9d7f-3bad51f7c0ed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:36.897797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1ab6df4f-6146-493a-9d7f-3bad51f7c0ed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:36.929101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-19b825f9-d1eb-4506-9eee-0ea349520e21 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:36.944229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-19b825f9-d1eb-4506-9eee-0ea349520e21 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1211 microversion: 2.1 time: 0.225004 Jul 27 20:13:36.945733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 26/50] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:36 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1211 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:36.970301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1ab6df4f-6146-493a-9d7f-3bad51f7c0ed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:36.988369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1ab6df4f-6146-493a-9d7f-3bad51f7c0ed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1236 microversion: 2.1 time: 0.097029 Jul 27 20:13:36.991185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 25/51] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:36 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:37.224798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-629e3c82-88b3-48dd-ac78-e54e6d054251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:37.225734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-629e3c82-88b3-48dd-ac78-e54e6d054251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:37.255545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-629e3c82-88b3-48dd-ac78-e54e6d054251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:37.255997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-629e3c82-88b3-48dd-ac78-e54e6d054251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:37.269544 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-629e3c82-88b3-48dd-ac78-e54e6d054251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:37.271770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-629e3c82-88b3-48dd-ac78-e54e6d054251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:37.440593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-629e3c82-88b3-48dd-ac78-e54e6d054251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:37.476274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-629e3c82-88b3-48dd-ac78-e54e6d054251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1274 microversion: 2.1 time: 0.256214 Jul 27 20:13:37.483107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 27/52] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:37 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1274 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:37.981874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2ffa7f9c-fe63-4b17-8f6f-47a46504932c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:37.982459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2ffa7f9c-fe63-4b17-8f6f-47a46504932c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:37.989964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ffa7f9c-fe63-4b17-8f6f-47a46504932c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:37.990456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ffa7f9c-fe63-4b17-8f6f-47a46504932c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:37.991190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ffa7f9c-fe63-4b17-8f6f-47a46504932c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:37.991619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ffa7f9c-fe63-4b17-8f6f-47a46504932c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:38.016061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-54ad9fc8-5529-463d-8cc5-9451697a32a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:38.021468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-54ad9fc8-5529-463d-8cc5-9451697a32a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:38.037047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54ad9fc8-5529-463d-8cc5-9451697a32a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:38.037504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54ad9fc8-5529-463d-8cc5-9451697a32a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:38.038279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54ad9fc8-5529-463d-8cc5-9451697a32a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:38.038710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54ad9fc8-5529-463d-8cc5-9451697a32a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:38.570935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-54ad9fc8-5529-463d-8cc5-9451697a32a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:38.583047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-54ad9fc8-5529-463d-8cc5-9451697a32a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1232 microversion: 2.1 time: 0.573811 Jul 27 20:13:38.584877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 28/53] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:38 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1232 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:38.599671 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dfe3cb83-a377-48ee-83fe-68ca82ccc4f2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:38.601228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dfe3cb83-a377-48ee-83fe-68ca82ccc4f2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:38.605368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2ffa7f9c-fe63-4b17-8f6f-47a46504932c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:38.610006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb83-a377-48ee-83fe-68ca82ccc4f2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:38.610526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb83-a377-48ee-83fe-68ca82ccc4f2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:38.611499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb83-a377-48ee-83fe-68ca82ccc4f2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:38.612080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe3cb83-a377-48ee-83fe-68ca82ccc4f2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:38.621458 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2ffa7f9c-fe63-4b17-8f6f-47a46504932c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1267 microversion: 2.1 time: 0.643574 Jul 27 20:13:38.624195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 26/54] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:37 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1267 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:38.828390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfe3cb83-a377-48ee-83fe-68ca82ccc4f2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:38.836130 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dfe3cb83-a377-48ee-83fe-68ca82ccc4f2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1280 microversion: 2.1 time: 0.248106 Jul 27 20:13:38.836790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 29/55] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:38 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1280 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:39.607211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-01a4e6e9-ca60-468d-8d05-fc3bcacfe160 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:39.607853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-01a4e6e9-ca60-468d-8d05-fc3bcacfe160 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:39.625046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-01a4e6e9-ca60-468d-8d05-fc3bcacfe160 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:39.625046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-01a4e6e9-ca60-468d-8d05-fc3bcacfe160 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:39.625046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-01a4e6e9-ca60-468d-8d05-fc3bcacfe160 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:39.625046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-01a4e6e9-ca60-468d-8d05-fc3bcacfe160 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:39.651622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8270683a-584e-4acc-87e1-54d349d5eb72 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:39.652407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8270683a-584e-4acc-87e1-54d349d5eb72 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:39.666102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8270683a-584e-4acc-87e1-54d349d5eb72 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:39.666807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8270683a-584e-4acc-87e1-54d349d5eb72 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:39.667821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8270683a-584e-4acc-87e1-54d349d5eb72 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:39.668963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8270683a-584e-4acc-87e1-54d349d5eb72 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:40.085598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-01a4e6e9-ca60-468d-8d05-fc3bcacfe160 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:40.094668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-01a4e6e9-ca60-468d-8d05-fc3bcacfe160 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1306 microversion: 2.1 time: 0.491995 Jul 27 20:13:40.106616 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 27/56] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:39 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1306 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:40.111484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-767964cb-cc22-45e6-9459-88c534ce8895 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:40.112093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-767964cb-cc22-45e6-9459-88c534ce8895 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:40.144745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-767964cb-cc22-45e6-9459-88c534ce8895 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:40.145455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-767964cb-cc22-45e6-9459-88c534ce8895 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:40.149204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-767964cb-cc22-45e6-9459-88c534ce8895 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:40.150786 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-767964cb-cc22-45e6-9459-88c534ce8895 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:40.176227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8270683a-584e-4acc-87e1-54d349d5eb72 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:40.185804 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8270683a-584e-4acc-87e1-54d349d5eb72 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1273 microversion: 2.1 time: 0.540721 Jul 27 20:13:40.201089 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 30/57] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:39 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1273 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:40.641871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-767964cb-cc22-45e6-9459-88c534ce8895 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:40.641871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-767964cb-cc22-45e6-9459-88c534ce8895 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.355038 Jul 27 20:13:40.641871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 28/58] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:40 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:41.118789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cbdf3203-63d1-4729-8a0b-68e9cc10ffea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:41.120288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cbdf3203-63d1-4729-8a0b-68e9cc10ffea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:41.126858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbdf3203-63d1-4729-8a0b-68e9cc10ffea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:41.127732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbdf3203-63d1-4729-8a0b-68e9cc10ffea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:41.128775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbdf3203-63d1-4729-8a0b-68e9cc10ffea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:41.129452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbdf3203-63d1-4729-8a0b-68e9cc10ffea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:41.213623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ad159e6a-45b9-4f81-92ac-37336f4147ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:41.214495 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ad159e6a-45b9-4f81-92ac-37336f4147ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:41.228400 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad159e6a-45b9-4f81-92ac-37336f4147ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:41.233060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad159e6a-45b9-4f81-92ac-37336f4147ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:41.235790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad159e6a-45b9-4f81-92ac-37336f4147ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:41.236576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad159e6a-45b9-4f81-92ac-37336f4147ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:41.243635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cbdf3203-63d1-4729-8a0b-68e9cc10ffea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:41.262454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cbdf3203-63d1-4729-8a0b-68e9cc10ffea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1294 microversion: 2.1 time: 0.148652 Jul 27 20:13:41.265973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:41 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1294 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:41.534462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ad159e6a-45b9-4f81-92ac-37336f4147ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:41.548589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ad159e6a-45b9-4f81-92ac-37336f4147ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.335870 Jul 27 20:13:41.548589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 29/60] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:41 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:41.658073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bd7931cc-448f-414b-a147-f182ec67e3ed tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:41.658073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bd7931cc-448f-414b-a147-f182ec67e3ed tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:41.663915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd7931cc-448f-414b-a147-f182ec67e3ed tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:41.666476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd7931cc-448f-414b-a147-f182ec67e3ed tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:41.667494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd7931cc-448f-414b-a147-f182ec67e3ed tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:41.668710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd7931cc-448f-414b-a147-f182ec67e3ed tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:41.807908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bd7931cc-448f-414b-a147-f182ec67e3ed tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:41.815884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bd7931cc-448f-414b-a147-f182ec67e3ed tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.163470 Jul 27 20:13:41.816713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 32/61] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:41 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:42.288231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ba90885e-4399-4a9e-bd4e-c8da57044da8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:42.289521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ba90885e-4399-4a9e-bd4e-c8da57044da8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:42.304340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ba90885e-4399-4a9e-bd4e-c8da57044da8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:42.305043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ba90885e-4399-4a9e-bd4e-c8da57044da8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:42.308446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ba90885e-4399-4a9e-bd4e-c8da57044da8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:42.309381 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ba90885e-4399-4a9e-bd4e-c8da57044da8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:42.421201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ba90885e-4399-4a9e-bd4e-c8da57044da8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:42.442694 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ba90885e-4399-4a9e-bd4e-c8da57044da8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1294 microversion: 2.1 time: 0.159196 Jul 27 20:13:42.463669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 30/62] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:42 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1294 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:42.567422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fe10dd5b-4448-4c3a-8843-e0acabfce63f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:42.568103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fe10dd5b-4448-4c3a-8843-e0acabfce63f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:42.576315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fe10dd5b-4448-4c3a-8843-e0acabfce63f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:42.576315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fe10dd5b-4448-4c3a-8843-e0acabfce63f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:42.576315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fe10dd5b-4448-4c3a-8843-e0acabfce63f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:42.576315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fe10dd5b-4448-4c3a-8843-e0acabfce63f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:42.750523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fe10dd5b-4448-4c3a-8843-e0acabfce63f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:42.760565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fe10dd5b-4448-4c3a-8843-e0acabfce63f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.197340 Jul 27 20:13:42.761367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 33/63] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:42 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:42.846561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5a5cc0ef-63d0-436b-8ca6-8f7ad7e38b56 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:42.846561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5a5cc0ef-63d0-436b-8ca6-8f7ad7e38b56 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:42.859575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a5cc0ef-63d0-436b-8ca6-8f7ad7e38b56 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:42.860137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a5cc0ef-63d0-436b-8ca6-8f7ad7e38b56 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:42.861113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a5cc0ef-63d0-436b-8ca6-8f7ad7e38b56 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:42.861575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a5cc0ef-63d0-436b-8ca6-8f7ad7e38b56 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:43.122879 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5a5cc0ef-63d0-436b-8ca6-8f7ad7e38b56 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:43.129753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5a5cc0ef-63d0-436b-8ca6-8f7ad7e38b56 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.288471 Jul 27 20:13:43.145584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 31/64] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:42 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:43.477020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-141cb6e8-1a52-47f7-b315-1ea9e2dd4f6e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:43.477916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-141cb6e8-1a52-47f7-b315-1ea9e2dd4f6e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:43.487101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:43.492610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-141cb6e8-1a52-47f7-b315-1ea9e2dd4f6e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:43.493825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-141cb6e8-1a52-47f7-b315-1ea9e2dd4f6e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:43.501320 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-141cb6e8-1a52-47f7-b315-1ea9e2dd4f6e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:43.502112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-141cb6e8-1a52-47f7-b315-1ea9e2dd4f6e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:43.720586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-141cb6e8-1a52-47f7-b315-1ea9e2dd4f6e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:43.735848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-141cb6e8-1a52-47f7-b315-1ea9e2dd4f6e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1294 microversion: 2.1 time: 0.262384 Jul 27 20:13:43.740620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 34/65] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:43 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1294 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:43.781537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ec9e0f71-0f47-4f2e-b26a-bcc8c23242a9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:43.782352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ec9e0f71-0f47-4f2e-b26a-bcc8c23242a9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:43.799220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec9e0f71-0f47-4f2e-b26a-bcc8c23242a9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:43.799851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec9e0f71-0f47-4f2e-b26a-bcc8c23242a9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:43.802418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec9e0f71-0f47-4f2e-b26a-bcc8c23242a9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:43.803820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec9e0f71-0f47-4f2e-b26a-bcc8c23242a9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:44.154719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-38d1361b-07fc-48e5-9ad2-5bea141cf7a3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:44.157293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-38d1361b-07fc-48e5-9ad2-5bea141cf7a3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:44.169749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38d1361b-07fc-48e5-9ad2-5bea141cf7a3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:44.172367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38d1361b-07fc-48e5-9ad2-5bea141cf7a3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:44.173654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38d1361b-07fc-48e5-9ad2-5bea141cf7a3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:44.176020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38d1361b-07fc-48e5-9ad2-5bea141cf7a3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:44.230397 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ec9e0f71-0f47-4f2e-b26a-bcc8c23242a9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:44.243675 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ec9e0f71-0f47-4f2e-b26a-bcc8c23242a9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.464672 Jul 27 20:13:44.245231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 32/66] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:43 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:44.768951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e9ffb462-57ca-47e1-9cc9-0c08f4d5a2eb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:44.769530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e9ffb462-57ca-47e1-9cc9-0c08f4d5a2eb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:44.779065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9ffb462-57ca-47e1-9cc9-0c08f4d5a2eb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:44.779540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9ffb462-57ca-47e1-9cc9-0c08f4d5a2eb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:44.780320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9ffb462-57ca-47e1-9cc9-0c08f4d5a2eb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:44.784579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9ffb462-57ca-47e1-9cc9-0c08f4d5a2eb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:45.096175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-38d1361b-07fc-48e5-9ad2-5bea141cf7a3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:45.107379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-38d1361b-07fc-48e5-9ad2-5bea141cf7a3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.955383 Jul 27 20:13:45.108151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 35/67] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:44 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:45.149628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e9ffb462-57ca-47e1-9cc9-0c08f4d5a2eb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:45.173692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e9ffb462-57ca-47e1-9cc9-0c08f4d5a2eb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1294 microversion: 2.1 time: 0.394511 Jul 27 20:13:45.176283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 33/68] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:44 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1294 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:45.269214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8ec6e350-1847-4edf-a8d7-44775991e6bf tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:45.270206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8ec6e350-1847-4edf-a8d7-44775991e6bf tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:45.283240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ec6e350-1847-4edf-a8d7-44775991e6bf tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:45.287937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ec6e350-1847-4edf-a8d7-44775991e6bf tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:45.289321 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ec6e350-1847-4edf-a8d7-44775991e6bf tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:45.290826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ec6e350-1847-4edf-a8d7-44775991e6bf tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:45.871342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=20 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.135230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a68d73b6-e333-436a-879f-7b1c8f062332 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:46.136734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a68d73b6-e333-436a-879f-7b1c8f062332 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:46.147908 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.150124 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a68d73b6-e333-436a-879f-7b1c8f062332 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:46.151172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a68d73b6-e333-436a-879f-7b1c8f062332 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:46.152143 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a68d73b6-e333-436a-879f-7b1c8f062332 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:46.160830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a68d73b6-e333-436a-879f-7b1c8f062332 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:46.254538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ec6e350-1847-4edf-a8d7-44775991e6bf tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:46.269891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8ec6e350-1847-4edf-a8d7-44775991e6bf tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 1.004601 Jul 27 20:13:46.271331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 36/69] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:45 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:46.287264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-91cf0469-0570-44a5-99b4-7a94095a833f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:46.293341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-91cf0469-0570-44a5-99b4-7a94095a833f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:46.317953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91cf0469-0570-44a5-99b4-7a94095a833f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:46.320735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91cf0469-0570-44a5-99b4-7a94095a833f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:46.323243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91cf0469-0570-44a5-99b4-7a94095a833f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:46.325929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91cf0469-0570-44a5-99b4-7a94095a833f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:46.697273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a68d73b6-e333-436a-879f-7b1c8f062332 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:46.724248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a68d73b6-e333-436a-879f-7b1c8f062332 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.597113 Jul 27 20:13:46.741001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 34/70] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:46 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:47.018403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=24 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:47.295976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91cf0469-0570-44a5-99b4-7a94095a833f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:47.311382 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-91cf0469-0570-44a5-99b4-7a94095a833f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 1.037843 Jul 27 20:13:47.311979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 37/71] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:46 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:47.314501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-4513e5b0-6efa-47de-aa42-a2ed322408f8 req-eb3a0eef-602b-4087-8b4f-e4bdacde4dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a5a8d3-3084-4481-bb85-14bc9e7f7122", "tag": "3b591409-24a6-4a88-a41e-f0ae3af44889"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:47.317523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-096f18e7-4047-45ed-8a6c-9c7d5ce99f4a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:47.326018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-096f18e7-4047-45ed-8a6c-9c7d5ce99f4a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:47.333957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-096f18e7-4047-45ed-8a6c-9c7d5ce99f4a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.337755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-096f18e7-4047-45ed-8a6c-9c7d5ce99f4a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.340149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-096f18e7-4047-45ed-8a6c-9c7d5ce99f4a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.341165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-096f18e7-4047-45ed-8a6c-9c7d5ce99f4a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.366324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4513e5b0-6efa-47de-aa42-a2ed322408f8 req-eb3a0eef-602b-4087-8b4f-e4bdacde4dba service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.366764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4513e5b0-6efa-47de-aa42-a2ed322408f8 req-eb3a0eef-602b-4087-8b4f-e4bdacde4dba service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.429623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-4513e5b0-6efa-47de-aa42-a2ed322408f8 req-eb3a0eef-602b-4087-8b4f-e4bdacde4dba service nova] Creating event network-changed:3b591409-24a6-4a88-a41e-f0ae3af44889 for instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 on hv-cinder-85124 Jul 27 20:13:47.430202 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4513e5b0-6efa-47de-aa42-a2ed322408f8 req-eb3a0eef-602b-4087-8b4f-e4bdacde4dba service nova] Acquired lock "compute-rpcapi-router" {{(pid=118273) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 20:13:47.441881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93d96ca0-d2bf-4014-b654-7a4617758a80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.444943 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93d96ca0-d2bf-4014-b654-7a4617758a80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.446776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93d96ca0-d2bf-4014-b654-7a4617758a80 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.448525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93d96ca0-d2bf-4014-b654-7a4617758a80 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.482679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.compute.rpcapi [None req-93d96ca0-d2bf-4014-b654-7a4617758a80 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 20:13:47.483587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93d96ca0-d2bf-4014-b654-7a4617758a80 None None] Releasing lock "compute-rpcapi-router" {{(pid=118273) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 20:13:47.543336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-93d96ca0-d2bf-4014-b654-7a4617758a80 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.532447 Jul 27 20:13:47.544272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 35/72] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:13:47.750478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d19ffa73-4a3c-43c9-8ff8-2ba6d0113358 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:47.751449 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d19ffa73-4a3c-43c9-8ff8-2ba6d0113358 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:47.763312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d19ffa73-4a3c-43c9-8ff8-2ba6d0113358 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.764001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d19ffa73-4a3c-43c9-8ff8-2ba6d0113358 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.764968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d19ffa73-4a3c-43c9-8ff8-2ba6d0113358 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.765556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d19ffa73-4a3c-43c9-8ff8-2ba6d0113358 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:48.279743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-096f18e7-4047-45ed-8a6c-9c7d5ce99f4a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:48.320246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-096f18e7-4047-45ed-8a6c-9c7d5ce99f4a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 1.006793 Jul 27 20:13:48.322320 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 38/73] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:47 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:48.350579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6e8217e5-1a9b-4cb7-9aa1-c4ab8f125275 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:48.357113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6e8217e5-1a9b-4cb7-9aa1-c4ab8f125275 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:48.401354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d19ffa73-4a3c-43c9-8ff8-2ba6d0113358 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:48.405955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e8217e5-1a9b-4cb7-9aa1-c4ab8f125275 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:48.411007 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e8217e5-1a9b-4cb7-9aa1-c4ab8f125275 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:48.415102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e8217e5-1a9b-4cb7-9aa1-c4ab8f125275 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:48.417228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d19ffa73-4a3c-43c9-8ff8-2ba6d0113358 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.666489 Jul 27 20:13:48.418157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e8217e5-1a9b-4cb7-9aa1-c4ab8f125275 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:48.419507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 36/74] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:47 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:48.991141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6e8217e5-1a9b-4cb7-9aa1-c4ab8f125275 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:49.027812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6e8217e5-1a9b-4cb7-9aa1-c4ab8f125275 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.699138 Jul 27 20:13:49.061208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 39/75] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:48 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:49.344673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4475871c-2120-4cb3-95e8-b87b9be53efb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:49.345286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4475871c-2120-4cb3-95e8-b87b9be53efb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:49.365758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4475871c-2120-4cb3-95e8-b87b9be53efb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:49.366536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4475871c-2120-4cb3-95e8-b87b9be53efb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:49.372976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4475871c-2120-4cb3-95e8-b87b9be53efb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:49.373735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4475871c-2120-4cb3-95e8-b87b9be53efb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:49.440352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4a9a8681-7df9-47e4-8c2e-65c6aacebaea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:49.441252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4a9a8681-7df9-47e4-8c2e-65c6aacebaea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:49.448226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a9a8681-7df9-47e4-8c2e-65c6aacebaea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:49.448694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a9a8681-7df9-47e4-8c2e-65c6aacebaea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:49.472980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a9a8681-7df9-47e4-8c2e-65c6aacebaea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:49.485827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a9a8681-7df9-47e4-8c2e-65c6aacebaea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:50.263665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4a9a8681-7df9-47e4-8c2e-65c6aacebaea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:50.278944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4a9a8681-7df9-47e4-8c2e-65c6aacebaea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.843359 Jul 27 20:13:50.279422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 40/76] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:49 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:50.292281 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cd5aef5c-05e0-403a-b2d7-5e4a0d4f384c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:50.293122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cd5aef5c-05e0-403a-b2d7-5e4a0d4f384c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:50.318981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd5aef5c-05e0-403a-b2d7-5e4a0d4f384c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:50.319434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd5aef5c-05e0-403a-b2d7-5e4a0d4f384c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:50.320206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd5aef5c-05e0-403a-b2d7-5e4a0d4f384c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:50.321168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd5aef5c-05e0-403a-b2d7-5e4a0d4f384c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:51.127157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4475871c-2120-4cb3-95e8-b87b9be53efb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:51.134881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4475871c-2120-4cb3-95e8-b87b9be53efb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 1.793983 Jul 27 20:13:51.138064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 37/77] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:49 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:51.515981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cd5aef5c-05e0-403a-b2d7-5e4a0d4f384c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:51.527673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-c8dd14d9-3a6a-4374-a711-bcfe37cb5016 req-3ecaf6b2-f99f-4030-bed4-a035edc52a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982bde5c-b64d-40ee-aedf-9553303e1aef", "tag": "492006da-836b-47ce-9b46-8ab395f9c9b5"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:51.539511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cd5aef5c-05e0-403a-b2d7-5e4a0d4f384c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 1.254438 Jul 27 20:13:51.540151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 41/78] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:50 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:51.560370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-40aa8e11-231b-4d67-bfaa-73301bac3b28 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:51.562986 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-40aa8e11-231b-4d67-bfaa-73301bac3b28 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:51.563929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-c8dd14d9-3a6a-4374-a711-bcfe37cb5016 req-3ecaf6b2-f99f-4030-bed4-a035edc52a5c service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:51.568371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-c8dd14d9-3a6a-4374-a711-bcfe37cb5016 req-3ecaf6b2-f99f-4030-bed4-a035edc52a5c service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:51.574542 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40aa8e11-231b-4d67-bfaa-73301bac3b28 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:51.575684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40aa8e11-231b-4d67-bfaa-73301bac3b28 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:51.577210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40aa8e11-231b-4d67-bfaa-73301bac3b28 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:51.584906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40aa8e11-231b-4d67-bfaa-73301bac3b28 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:51.587540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-c8dd14d9-3a6a-4374-a711-bcfe37cb5016 req-3ecaf6b2-f99f-4030-bed4-a035edc52a5c service nova] Creating event network-changed:492006da-836b-47ce-9b46-8ab395f9c9b5 for instance 982bde5c-b64d-40ee-aedf-9553303e1aef on hv-cinder-85124 Jul 27 20:13:51.594217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:51.596194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-c8dd14d9-3a6a-4374-a711-bcfe37cb5016 req-3ecaf6b2-f99f-4030-bed4-a035edc52a5c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.456581 Jul 27 20:13:51.599194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 38/79] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:52.157397 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b9e41090-6868-425d-93af-695de700b8bd tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:52.163202 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b9e41090-6868-425d-93af-695de700b8bd tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:52.173770 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9e41090-6868-425d-93af-695de700b8bd tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:52.174426 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9e41090-6868-425d-93af-695de700b8bd tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:52.176335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9e41090-6868-425d-93af-695de700b8bd tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:52.181108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9e41090-6868-425d-93af-695de700b8bd tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:52.246039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-40aa8e11-231b-4d67-bfaa-73301bac3b28 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:52.256338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-40aa8e11-231b-4d67-bfaa-73301bac3b28 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.711692 Jul 27 20:13:52.257362 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 42/80] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:51 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:52.564253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9f425883-e827-4949-82f6-7d233d6d2cad tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:52.564998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9f425883-e827-4949-82f6-7d233d6d2cad tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:52.579355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f425883-e827-4949-82f6-7d233d6d2cad tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:52.579355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f425883-e827-4949-82f6-7d233d6d2cad tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:52.579355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f425883-e827-4949-82f6-7d233d6d2cad tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:52.579355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f425883-e827-4949-82f6-7d233d6d2cad tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:52.730052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b9e41090-6868-425d-93af-695de700b8bd tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:52.738789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b9e41090-6868-425d-93af-695de700b8bd tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.585254 Jul 27 20:13:52.739373 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 39/81] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:52 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:53.216751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9f425883-e827-4949-82f6-7d233d6d2cad tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:53.224798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9f425883-e827-4949-82f6-7d233d6d2cad tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.666956 Jul 27 20:13:53.225384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 43/82] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:52 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:53.280175 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1f84f359-c7a5-488e-bad3-6b4e7376d9ad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:53.280884 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1f84f359-c7a5-488e-bad3-6b4e7376d9ad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:53.287768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f84f359-c7a5-488e-bad3-6b4e7376d9ad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:53.288293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f84f359-c7a5-488e-bad3-6b4e7376d9ad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:53.289094 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f84f359-c7a5-488e-bad3-6b4e7376d9ad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:53.289736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f84f359-c7a5-488e-bad3-6b4e7376d9ad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:53.471809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1f84f359-c7a5-488e-bad3-6b4e7376d9ad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:53.479487 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1f84f359-c7a5-488e-bad3-6b4e7376d9ad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.203558 Jul 27 20:13:53.480137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 40/83] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:53 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:53.765056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-172a51e0-a95a-4a61-ab86-acc50e861e18 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:53.766114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-172a51e0-a95a-4a61-ab86-acc50e861e18 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:53.768145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:53.773037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-172a51e0-a95a-4a61-ab86-acc50e861e18 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:53.773558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-172a51e0-a95a-4a61-ab86-acc50e861e18 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:53.774725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-172a51e0-a95a-4a61-ab86-acc50e861e18 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:53.775225 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-172a51e0-a95a-4a61-ab86-acc50e861e18 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:53.814456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-3ab39f3b-2e0d-46c5-bf57-2185c6335632 req-b2959991-6e63-4dce-ac6f-e1f6266d2efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d", "tag": "84027fbb-9bf0-449e-88d5-f3164a9148a2"}, {"name": "network-changed", "server_uuid": "77d4ea93-fe33-426a-aa16-4ecfa7521db5", "tag": "5583e13a-a514-4349-b84b-69d2a82f1085"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:53.819742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:53.826817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-3ab39f3b-2e0d-46c5-bf57-2185c6335632 req-b2959991-6e63-4dce-ac6f-e1f6266d2efa service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:53.840625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-3ab39f3b-2e0d-46c5-bf57-2185c6335632 req-b2959991-6e63-4dce-ac6f-e1f6266d2efa service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:53.840625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=97 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:53.841200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-3ab39f3b-2e0d-46c5-bf57-2185c6335632 req-b2959991-6e63-4dce-ac6f-e1f6266d2efa service nova] Creating event network-changed:84027fbb-9bf0-449e-88d5-f3164a9148a2 for instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d on hv-cinder-85124 Jul 27 20:13:53.841200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-3ab39f3b-2e0d-46c5-bf57-2185c6335632 req-b2959991-6e63-4dce-ac6f-e1f6266d2efa service nova] Creating event network-changed:5583e13a-a514-4349-b84b-69d2a82f1085 for instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 on hv-cinder-85124 Jul 27 20:13:53.847997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-3ab39f3b-2e0d-46c5-bf57-2185c6335632 req-b2959991-6e63-4dce-ac6f-e1f6266d2efa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039703 Jul 27 20:13:53.848967 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 41/84] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:13:54.143167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-172a51e0-a95a-4a61-ab86-acc50e861e18 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:54.152162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-172a51e0-a95a-4a61-ab86-acc50e861e18 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.391049 Jul 27 20:13:54.152800 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 44/85] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:53 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:54.248482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-868d9dde-53ce-43be-9cd1-26f612905469 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:54.249274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-868d9dde-53ce-43be-9cd1-26f612905469 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:54.255533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-868d9dde-53ce-43be-9cd1-26f612905469 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:54.255981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-868d9dde-53ce-43be-9cd1-26f612905469 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:54.256959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-868d9dde-53ce-43be-9cd1-26f612905469 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:54.257397 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-868d9dde-53ce-43be-9cd1-26f612905469 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:54.508695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-08b7501b-eafc-43fa-984f-862bb49be07c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:54.508695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-08b7501b-eafc-43fa-984f-862bb49be07c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:54.522780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08b7501b-eafc-43fa-984f-862bb49be07c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:54.527375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08b7501b-eafc-43fa-984f-862bb49be07c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:54.529192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08b7501b-eafc-43fa-984f-862bb49be07c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:54.530244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08b7501b-eafc-43fa-984f-862bb49be07c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:54.700098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-868d9dde-53ce-43be-9cd1-26f612905469 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:54.711871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-868d9dde-53ce-43be-9cd1-26f612905469 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.466846 Jul 27 20:13:54.711871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 42/86] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:54 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:54.826866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-08b7501b-eafc-43fa-984f-862bb49be07c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:54.826866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-08b7501b-eafc-43fa-984f-862bb49be07c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.323858 Jul 27 20:13:54.841266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 45/87] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:54 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:55.173388 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cef0d9e6-6417-42d0-b539-06eb6fe2616a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:55.174001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cef0d9e6-6417-42d0-b539-06eb6fe2616a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:55.179920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cef0d9e6-6417-42d0-b539-06eb6fe2616a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:55.180367 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cef0d9e6-6417-42d0-b539-06eb6fe2616a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:55.181143 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cef0d9e6-6417-42d0-b539-06eb6fe2616a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:55.181572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cef0d9e6-6417-42d0-b539-06eb6fe2616a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:55.317574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cef0d9e6-6417-42d0-b539-06eb6fe2616a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:55.325185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cef0d9e6-6417-42d0-b539-06eb6fe2616a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.155627 Jul 27 20:13:55.329031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 43/88] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:55 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:55.731115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-141674a3-7969-412a-ba61-9a15cb2b501b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:55.731730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-141674a3-7969-412a-ba61-9a15cb2b501b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:55.738052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-141674a3-7969-412a-ba61-9a15cb2b501b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:55.738499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-141674a3-7969-412a-ba61-9a15cb2b501b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:55.739251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-141674a3-7969-412a-ba61-9a15cb2b501b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:55.739849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-141674a3-7969-412a-ba61-9a15cb2b501b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:55.848351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4cc10a8c-fe9c-4794-b027-482af4debc4d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:55.849103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4cc10a8c-fe9c-4794-b027-482af4debc4d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:55.859998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cc10a8c-fe9c-4794-b027-482af4debc4d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:55.861493 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cc10a8c-fe9c-4794-b027-482af4debc4d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:55.863820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cc10a8c-fe9c-4794-b027-482af4debc4d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:55.864915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cc10a8c-fe9c-4794-b027-482af4debc4d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:55.912446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-141674a3-7969-412a-ba61-9a15cb2b501b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:55.932037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-141674a3-7969-412a-ba61-9a15cb2b501b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.194312 Jul 27 20:13:55.934166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 46/89] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:55 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:56.032001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4cc10a8c-fe9c-4794-b027-482af4debc4d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:56.040428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4cc10a8c-fe9c-4794-b027-482af4debc4d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.196261 Jul 27 20:13:56.041353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 44/90] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:55 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:56.352058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-87db3a93-5a99-4fe5-b7b7-b6280d21787f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:56.352704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-87db3a93-5a99-4fe5-b7b7-b6280d21787f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:56.358554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87db3a93-5a99-4fe5-b7b7-b6280d21787f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:56.358996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87db3a93-5a99-4fe5-b7b7-b6280d21787f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:56.359746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87db3a93-5a99-4fe5-b7b7-b6280d21787f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:56.360172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87db3a93-5a99-4fe5-b7b7-b6280d21787f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:56.498986 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-87db3a93-5a99-4fe5-b7b7-b6280d21787f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:56.506689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-87db3a93-5a99-4fe5-b7b7-b6280d21787f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.159442 Jul 27 20:13:56.507447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 47/91] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:56 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:56.957861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-62bae23b-497b-4eba-ac23-21ae3c8e0430 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:56.958560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-62bae23b-497b-4eba-ac23-21ae3c8e0430 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:56.964858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62bae23b-497b-4eba-ac23-21ae3c8e0430 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:56.965391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62bae23b-497b-4eba-ac23-21ae3c8e0430 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:56.966236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62bae23b-497b-4eba-ac23-21ae3c8e0430 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:56.966874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62bae23b-497b-4eba-ac23-21ae3c8e0430 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:57.063308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-28868174-96e0-4467-94ee-5864eb04a1fb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:57.064033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-28868174-96e0-4467-94ee-5864eb04a1fb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:57.073933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-28868174-96e0-4467-94ee-5864eb04a1fb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:57.074700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-28868174-96e0-4467-94ee-5864eb04a1fb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:57.075691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-28868174-96e0-4467-94ee-5864eb04a1fb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:57.076337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-28868174-96e0-4467-94ee-5864eb04a1fb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:57.144956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-62bae23b-497b-4eba-ac23-21ae3c8e0430 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:57.181086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-62bae23b-497b-4eba-ac23-21ae3c8e0430 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.227056 Jul 27 20:13:57.186195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 45/92] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:56 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:57.249479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-28868174-96e0-4467-94ee-5864eb04a1fb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:57.260268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-28868174-96e0-4467-94ee-5864eb04a1fb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.201465 Jul 27 20:13:57.273805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 48/93] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:57 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:57.528621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bda214ee-674d-43d8-826a-0cffc4736af8 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:57.529416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bda214ee-674d-43d8-826a-0cffc4736af8 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:57.534690 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:57.538803 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bda214ee-674d-43d8-826a-0cffc4736af8 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:57.543399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bda214ee-674d-43d8-826a-0cffc4736af8 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:57.543399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bda214ee-674d-43d8-826a-0cffc4736af8 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:57.543399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bda214ee-674d-43d8-826a-0cffc4736af8 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:57.681184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bda214ee-674d-43d8-826a-0cffc4736af8 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:57.691127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bda214ee-674d-43d8-826a-0cffc4736af8 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.166490 Jul 27 20:13:57.691726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 46/94] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:57 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:58.212327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-21d55830-a4fa-4fa6-a11e-ae692d8abb7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:58.212963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-21d55830-a4fa-4fa6-a11e-ae692d8abb7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:58.218972 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21d55830-a4fa-4fa6-a11e-ae692d8abb7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:58.219417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21d55830-a4fa-4fa6-a11e-ae692d8abb7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:58.220164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21d55830-a4fa-4fa6-a11e-ae692d8abb7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:58.220618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21d55830-a4fa-4fa6-a11e-ae692d8abb7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:58.283790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-25d228fa-97b1-45f7-a7aa-6c33bb710542 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:58.284765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-25d228fa-97b1-45f7-a7aa-6c33bb710542 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:58.296049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25d228fa-97b1-45f7-a7aa-6c33bb710542 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:58.297063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25d228fa-97b1-45f7-a7aa-6c33bb710542 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:58.299638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25d228fa-97b1-45f7-a7aa-6c33bb710542 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:58.300292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25d228fa-97b1-45f7-a7aa-6c33bb710542 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:58.416312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-21d55830-a4fa-4fa6-a11e-ae692d8abb7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:58.426479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-21d55830-a4fa-4fa6-a11e-ae692d8abb7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.217574 Jul 27 20:13:58.429342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 49/95] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:58 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:58.512850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-25d228fa-97b1-45f7-a7aa-6c33bb710542 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:58.521519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-25d228fa-97b1-45f7-a7aa-6c33bb710542 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.242262 Jul 27 20:13:58.522391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 47/96] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:58 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:58.713739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7038ce13-e291-464d-8c79-2669588625d4 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:58.714350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7038ce13-e291-464d-8c79-2669588625d4 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:58.723805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7038ce13-e291-464d-8c79-2669588625d4 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:58.724249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7038ce13-e291-464d-8c79-2669588625d4 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:58.725043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7038ce13-e291-464d-8c79-2669588625d4 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:58.725474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7038ce13-e291-464d-8c79-2669588625d4 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:58.861524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7038ce13-e291-464d-8c79-2669588625d4 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:58.870565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7038ce13-e291-464d-8c79-2669588625d4 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.160623 Jul 27 20:13:58.871528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 50/97] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:58 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:59.448573 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d53bc8ce-adf2-4b5f-a127-a3fc9eb6ddc6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:59.449189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d53bc8ce-adf2-4b5f-a127-a3fc9eb6ddc6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:59.455171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d53bc8ce-adf2-4b5f-a127-a3fc9eb6ddc6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:59.455602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d53bc8ce-adf2-4b5f-a127-a3fc9eb6ddc6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:59.456346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d53bc8ce-adf2-4b5f-a127-a3fc9eb6ddc6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:59.456800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d53bc8ce-adf2-4b5f-a127-a3fc9eb6ddc6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:59.542816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8d1902be-8edf-4c85-9f36-a4d3d99f1db0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:59.543534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8d1902be-8edf-4c85-9f36-a4d3d99f1db0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:59.550626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d1902be-8edf-4c85-9f36-a4d3d99f1db0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:59.551843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d1902be-8edf-4c85-9f36-a4d3d99f1db0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:59.552577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d1902be-8edf-4c85-9f36-a4d3d99f1db0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:59.553245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d1902be-8edf-4c85-9f36-a4d3d99f1db0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:59.614278 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d53bc8ce-adf2-4b5f-a127-a3fc9eb6ddc6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:59.622661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d53bc8ce-adf2-4b5f-a127-a3fc9eb6ddc6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.178636 Jul 27 20:13:59.623316 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 48/98] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:59 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:59.700528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8d1902be-8edf-4c85-9f36-a4d3d99f1db0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:59.709951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8d1902be-8edf-4c85-9f36-a4d3d99f1db0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.171693 Jul 27 20:13:59.710614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 51/99] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:59 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:59.891226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e3bbcb17-4ef9-4beb-adfe-08ede97c8a53 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:59.891847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e3bbcb17-4ef9-4beb-adfe-08ede97c8a53 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:59.897937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3bbcb17-4ef9-4beb-adfe-08ede97c8a53 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:59.898318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3bbcb17-4ef9-4beb-adfe-08ede97c8a53 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:59.899435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3bbcb17-4ef9-4beb-adfe-08ede97c8a53 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:59.900030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3bbcb17-4ef9-4beb-adfe-08ede97c8a53 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:00.079283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e3bbcb17-4ef9-4beb-adfe-08ede97c8a53 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:00.089269 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e3bbcb17-4ef9-4beb-adfe-08ede97c8a53 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.201503 Jul 27 20:14:00.093189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 49/100] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:59 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:00.644714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-973b5226-62aa-4854-bc21-22605b9d6623 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:00.645473 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-973b5226-62aa-4854-bc21-22605b9d6623 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:00.652659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-973b5226-62aa-4854-bc21-22605b9d6623 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:00.653115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-973b5226-62aa-4854-bc21-22605b9d6623 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:00.653982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-973b5226-62aa-4854-bc21-22605b9d6623 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:00.654499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-973b5226-62aa-4854-bc21-22605b9d6623 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:00.731702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8ea605c6-03de-4964-a821-bd4c3b4ac721 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:00.732319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8ea605c6-03de-4964-a821-bd4c3b4ac721 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:00.740133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ea605c6-03de-4964-a821-bd4c3b4ac721 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:00.740869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ea605c6-03de-4964-a821-bd4c3b4ac721 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:00.742964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ea605c6-03de-4964-a821-bd4c3b4ac721 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:00.743642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ea605c6-03de-4964-a821-bd4c3b4ac721 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:00.887411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-973b5226-62aa-4854-bc21-22605b9d6623 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:00.900459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-973b5226-62aa-4854-bc21-22605b9d6623 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.259362 Jul 27 20:14:00.901244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 52/101] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:00 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:00.932977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ea605c6-03de-4964-a821-bd4c3b4ac721 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:00.942675 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8ea605c6-03de-4964-a821-bd4c3b4ac721 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.215353 Jul 27 20:14:00.944434 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 50/102] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:00 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:01.114373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-71631c96-03b9-4651-8fe0-9e7707b622a6 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:01.115134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-71631c96-03b9-4651-8fe0-9e7707b622a6 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:01.122144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71631c96-03b9-4651-8fe0-9e7707b622a6 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:01.122805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71631c96-03b9-4651-8fe0-9e7707b622a6 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:01.123664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71631c96-03b9-4651-8fe0-9e7707b622a6 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:01.124187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71631c96-03b9-4651-8fe0-9e7707b622a6 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:01.285247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-71631c96-03b9-4651-8fe0-9e7707b622a6 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:01.293175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-71631c96-03b9-4651-8fe0-9e7707b622a6 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.184386 Jul 27 20:14:01.293939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 53/103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:01 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:01.925819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3d0a1a72-2383-4590-a4b3-e6d1b256f7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:01.926710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3d0a1a72-2383-4590-a4b3-e6d1b256f7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:01.936950 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d0a1a72-2383-4590-a4b3-e6d1b256f7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:01.937698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d0a1a72-2383-4590-a4b3-e6d1b256f7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:01.939120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d0a1a72-2383-4590-a4b3-e6d1b256f7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:01.940082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d0a1a72-2383-4590-a4b3-e6d1b256f7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:01.968112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-89ad0cab-827f-42d4-a9af-25b5662e8c49 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:01.968910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-89ad0cab-827f-42d4-a9af-25b5662e8c49 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:01.976241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89ad0cab-827f-42d4-a9af-25b5662e8c49 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:01.978140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89ad0cab-827f-42d4-a9af-25b5662e8c49 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:01.982003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89ad0cab-827f-42d4-a9af-25b5662e8c49 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:01.982003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89ad0cab-827f-42d4-a9af-25b5662e8c49 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:02.192373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-89ad0cab-827f-42d4-a9af-25b5662e8c49 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:02.205755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-89ad0cab-827f-42d4-a9af-25b5662e8c49 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.243510 Jul 27 20:14:02.206923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 54/104] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:01 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:02.221508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3d0a1a72-2383-4590-a4b3-e6d1b256f7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:02.233315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3d0a1a72-2383-4590-a4b3-e6d1b256f7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.314785 Jul 27 20:14:02.234448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 51/105] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:01 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:02.313209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d5b72a68-c37d-4e5b-9722-227a14a0219a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:02.313813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d5b72a68-c37d-4e5b-9722-227a14a0219a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:02.319588 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5b72a68-c37d-4e5b-9722-227a14a0219a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:02.320033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5b72a68-c37d-4e5b-9722-227a14a0219a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:02.321368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5b72a68-c37d-4e5b-9722-227a14a0219a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:02.321799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5b72a68-c37d-4e5b-9722-227a14a0219a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:02.511324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d5b72a68-c37d-4e5b-9722-227a14a0219a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:02.520885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d5b72a68-c37d-4e5b-9722-227a14a0219a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.211529 Jul 27 20:14:02.521790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 55/106] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:02 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:03.060604 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-2f6df918-bcf7-4546-89d5-04691c3b0cca req-5ae58580-4ae0-42ce-b587-2cea95ce3e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982bde5c-b64d-40ee-aedf-9553303e1aef", "name": "network-vif-plugged", "status": "completed", "tag": "492006da-836b-47ce-9b46-8ab395f9c9b5"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:03.071630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2f6df918-bcf7-4546-89d5-04691c3b0cca req-5ae58580-4ae0-42ce-b587-2cea95ce3e4c service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:03.072280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2f6df918-bcf7-4546-89d5-04691c3b0cca req-5ae58580-4ae0-42ce-b587-2cea95ce3e4c service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:03.088714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-2f6df918-bcf7-4546-89d5-04691c3b0cca req-5ae58580-4ae0-42ce-b587-2cea95ce3e4c service nova] Creating event network-vif-plugged:492006da-836b-47ce-9b46-8ab395f9c9b5 for instance 982bde5c-b64d-40ee-aedf-9553303e1aef on hv-cinder-85124 Jul 27 20:14:03.097783 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-2f6df918-bcf7-4546-89d5-04691c3b0cca req-5ae58580-4ae0-42ce-b587-2cea95ce3e4c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134697 Jul 27 20:14:03.098231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 52/107] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:14:03.230368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-206abb50-5eaa-4001-bd8f-db32b72e9dad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:03.230966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-206abb50-5eaa-4001-bd8f-db32b72e9dad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:03.238442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-206abb50-5eaa-4001-bd8f-db32b72e9dad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:03.239107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-206abb50-5eaa-4001-bd8f-db32b72e9dad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:03.240011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-206abb50-5eaa-4001-bd8f-db32b72e9dad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:03.240826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-206abb50-5eaa-4001-bd8f-db32b72e9dad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:03.255332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-16ab0b45-fda2-4bb2-a697-725a19aa61c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:03.256752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-16ab0b45-fda2-4bb2-a697-725a19aa61c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:03.263824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16ab0b45-fda2-4bb2-a697-725a19aa61c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:03.264274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16ab0b45-fda2-4bb2-a697-725a19aa61c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:03.265201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16ab0b45-fda2-4bb2-a697-725a19aa61c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:03.265635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16ab0b45-fda2-4bb2-a697-725a19aa61c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:03.470178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-16ab0b45-fda2-4bb2-a697-725a19aa61c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:03.479567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-16ab0b45-fda2-4bb2-a697-725a19aa61c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.228979 Jul 27 20:14:03.480174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 53/108] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:03 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:03.482690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-206abb50-5eaa-4001-bd8f-db32b72e9dad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:03.495130 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-206abb50-5eaa-4001-bd8f-db32b72e9dad tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.269107 Jul 27 20:14:03.495738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 56/109] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:03 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:03.543092 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f28e32e5-a6fc-4fe3-bda1-32cdb96ddf92 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:03.543692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f28e32e5-a6fc-4fe3-bda1-32cdb96ddf92 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:03.549661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f28e32e5-a6fc-4fe3-bda1-32cdb96ddf92 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:03.550105 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f28e32e5-a6fc-4fe3-bda1-32cdb96ddf92 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:03.551006 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f28e32e5-a6fc-4fe3-bda1-32cdb96ddf92 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:03.551429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f28e32e5-a6fc-4fe3-bda1-32cdb96ddf92 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:03.682237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f28e32e5-a6fc-4fe3-bda1-32cdb96ddf92 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:03.690725 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f28e32e5-a6fc-4fe3-bda1-32cdb96ddf92 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.152141 Jul 27 20:14:03.691292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 54/110] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:03 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:04.501326 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1b4717ae-cdd7-4f1c-8ebd-751d3dd76be1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:04.501923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1b4717ae-cdd7-4f1c-8ebd-751d3dd76be1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:04.508616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1b4717ae-cdd7-4f1c-8ebd-751d3dd76be1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:04.509058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1b4717ae-cdd7-4f1c-8ebd-751d3dd76be1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:04.509799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1b4717ae-cdd7-4f1c-8ebd-751d3dd76be1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:04.510374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1b4717ae-cdd7-4f1c-8ebd-751d3dd76be1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:04.516357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d580a2ed-7d0f-47b8-98e9-73be195272c0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:04.517184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d580a2ed-7d0f-47b8-98e9-73be195272c0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:04.523777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d580a2ed-7d0f-47b8-98e9-73be195272c0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:04.524334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d580a2ed-7d0f-47b8-98e9-73be195272c0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:04.525230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d580a2ed-7d0f-47b8-98e9-73be195272c0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:04.525850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d580a2ed-7d0f-47b8-98e9-73be195272c0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:04.725618 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d580a2ed-7d0f-47b8-98e9-73be195272c0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:04.728954 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1b4717ae-cdd7-4f1c-8ebd-751d3dd76be1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:04.734068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d580a2ed-7d0f-47b8-98e9-73be195272c0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.222255 Jul 27 20:14:04.748071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 55/111] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:04 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:04.748231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1b4717ae-cdd7-4f1c-8ebd-751d3dd76be1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.238682 Jul 27 20:14:04.748231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 57/112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:04 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:04.748438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-60c798f5-d210-4b29-a83a-4479eb67ea86 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:04.748438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-60c798f5-d210-4b29-a83a-4479eb67ea86 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:04.748438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-60c798f5-d210-4b29-a83a-4479eb67ea86 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:04.748438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-60c798f5-d210-4b29-a83a-4479eb67ea86 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:04.748747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-60c798f5-d210-4b29-a83a-4479eb67ea86 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:04.748747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-60c798f5-d210-4b29-a83a-4479eb67ea86 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:04.874999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-60c798f5-d210-4b29-a83a-4479eb67ea86 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:04.882420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-60c798f5-d210-4b29-a83a-4479eb67ea86 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.146807 Jul 27 20:14:04.883045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 56/113] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:04 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:05.755968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5143ee2b-90f3-4ea5-996d-de45484b72e8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:05.757330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4f59756f-f921-4092-8e30-71bf709c3abb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:05.757814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5143ee2b-90f3-4ea5-996d-de45484b72e8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:05.758232 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4f59756f-f921-4092-8e30-71bf709c3abb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:05.764973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5143ee2b-90f3-4ea5-996d-de45484b72e8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:05.765563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4f59756f-f921-4092-8e30-71bf709c3abb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:05.765697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5143ee2b-90f3-4ea5-996d-de45484b72e8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:05.766335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4f59756f-f921-4092-8e30-71bf709c3abb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:05.766472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5143ee2b-90f3-4ea5-996d-de45484b72e8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:05.767002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5143ee2b-90f3-4ea5-996d-de45484b72e8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:05.767272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4f59756f-f921-4092-8e30-71bf709c3abb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:05.767984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4f59756f-f921-4092-8e30-71bf709c3abb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:06.026710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5143ee2b-90f3-4ea5-996d-de45484b72e8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:06.031760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:06.037217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5143ee2b-90f3-4ea5-996d-de45484b72e8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.285439 Jul 27 20:14:06.038159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 58/114] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:05 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:06.043313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4f59756f-f921-4092-8e30-71bf709c3abb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:06.051524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e9e01e20-4419-4395-a43c-44e5833b79e2 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:06.052251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e9e01e20-4419-4395-a43c-44e5833b79e2 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:06.060440 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4f59756f-f921-4092-8e30-71bf709c3abb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.306864 Jul 27 20:14:06.061348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 57/115] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:05 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:06.066522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9e01e20-4419-4395-a43c-44e5833b79e2 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:06.067289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9e01e20-4419-4395-a43c-44e5833b79e2 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:06.070114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9e01e20-4419-4395-a43c-44e5833b79e2 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:06.070813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9e01e20-4419-4395-a43c-44e5833b79e2 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:06.268275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e9e01e20-4419-4395-a43c-44e5833b79e2 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:06.276554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e9e01e20-4419-4395-a43c-44e5833b79e2 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.237366 Jul 27 20:14:06.277130 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 59/116] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:06 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:07.061228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5022d15d-b4f2-442a-bc17-75f434c2fcf3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:07.062028 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5022d15d-b4f2-442a-bc17-75f434c2fcf3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:07.068027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5022d15d-b4f2-442a-bc17-75f434c2fcf3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.068509 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5022d15d-b4f2-442a-bc17-75f434c2fcf3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.069268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5022d15d-b4f2-442a-bc17-75f434c2fcf3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.069697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5022d15d-b4f2-442a-bc17-75f434c2fcf3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.085649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-783a0130-2199-4227-aaf2-8614cf367e5b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:07.085649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-783a0130-2199-4227-aaf2-8614cf367e5b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:07.095945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-783a0130-2199-4227-aaf2-8614cf367e5b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.096413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-783a0130-2199-4227-aaf2-8614cf367e5b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.097172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-783a0130-2199-4227-aaf2-8614cf367e5b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.097837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-783a0130-2199-4227-aaf2-8614cf367e5b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.291843 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5022d15d-b4f2-442a-bc17-75f434c2fcf3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:07.300446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5022d15d-b4f2-442a-bc17-75f434c2fcf3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.242978 Jul 27 20:14:07.300997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 58/117] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:07 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:07.310943 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-283cc360-ed56-4cd8-9a70-67d16a440321 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:07.315225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-283cc360-ed56-4cd8-9a70-67d16a440321 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:07.323986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-283cc360-ed56-4cd8-9a70-67d16a440321 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.326034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-283cc360-ed56-4cd8-9a70-67d16a440321 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.327681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-283cc360-ed56-4cd8-9a70-67d16a440321 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.328259 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-283cc360-ed56-4cd8-9a70-67d16a440321 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.333164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:07.361142 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-783a0130-2199-4227-aaf2-8614cf367e5b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:07.374885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-783a0130-2199-4227-aaf2-8614cf367e5b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.294456 Jul 27 20:14:07.378467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 60/118] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:07 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:07.681966 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-283cc360-ed56-4cd8-9a70-67d16a440321 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:07.689664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-283cc360-ed56-4cd8-9a70-67d16a440321 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.384532 Jul 27 20:14:07.690559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 59/119] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:07 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:08.204855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-5f06b564-1aaa-478e-808e-e424e6c4b43e req-72d5104a-0dfa-44bf-8f90-8142510b2ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a5a8d3-3084-4481-bb85-14bc9e7f7122", "name": "network-vif-plugged", "status": "completed", "tag": "3b591409-24a6-4a88-a41e-f0ae3af44889"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:08.222867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5f06b564-1aaa-478e-808e-e424e6c4b43e req-72d5104a-0dfa-44bf-8f90-8142510b2ca2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:08.223353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5f06b564-1aaa-478e-808e-e424e6c4b43e req-72d5104a-0dfa-44bf-8f90-8142510b2ca2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:08.246029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-5f06b564-1aaa-478e-808e-e424e6c4b43e req-72d5104a-0dfa-44bf-8f90-8142510b2ca2 service nova] Creating event network-vif-plugged:3b591409-24a6-4a88-a41e-f0ae3af44889 for instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 on hv-cinder-85124 Jul 27 20:14:08.246576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5f06b564-1aaa-478e-808e-e424e6c4b43e req-72d5104a-0dfa-44bf-8f90-8142510b2ca2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118274) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 20:14:08.247738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55c14a5e-74b4-4061-a7ca-fe4a82a3c598 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:08.248186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55c14a5e-74b4-4061-a7ca-fe4a82a3c598 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:08.248997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55c14a5e-74b4-4061-a7ca-fe4a82a3c598 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:08.249428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55c14a5e-74b4-4061-a7ca-fe4a82a3c598 None None] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:08.260307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.compute.rpcapi [None req-55c14a5e-74b4-4061-a7ca-fe4a82a3c598 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 20:14:08.261226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55c14a5e-74b4-4061-a7ca-fe4a82a3c598 None None] Releasing lock "compute-rpcapi-router" {{(pid=118274) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 20:14:08.279174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-55c14a5e-74b4-4061-a7ca-fe4a82a3c598 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079012 Jul 27 20:14:08.280099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 61/120] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:14:08.322354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-154753f4-8975-442b-9ace-5cdbff8fc73a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:08.331535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-154753f4-8975-442b-9ace-5cdbff8fc73a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:08.352898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-154753f4-8975-442b-9ace-5cdbff8fc73a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:08.353716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-154753f4-8975-442b-9ace-5cdbff8fc73a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:08.355013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-154753f4-8975-442b-9ace-5cdbff8fc73a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:08.355447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-154753f4-8975-442b-9ace-5cdbff8fc73a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:08.408694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bbfec213-b995-4f88-a9ef-0399f37930dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:08.410435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bbfec213-b995-4f88-a9ef-0399f37930dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:08.418697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbfec213-b995-4f88-a9ef-0399f37930dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:08.419406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbfec213-b995-4f88-a9ef-0399f37930dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:08.420664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbfec213-b995-4f88-a9ef-0399f37930dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:08.421240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbfec213-b995-4f88-a9ef-0399f37930dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:08.605250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-154753f4-8975-442b-9ace-5cdbff8fc73a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:08.623969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-154753f4-8975-442b-9ace-5cdbff8fc73a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1322 microversion: 2.1 time: 0.306221 Jul 27 20:14:08.636570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 60/121] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:08 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:08.646693 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bbfec213-b995-4f88-a9ef-0399f37930dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:08.666638 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bbfec213-b995-4f88-a9ef-0399f37930dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.264097 Jul 27 20:14:08.667227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 62/122] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:08 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:08.710473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0772abf7-e758-425e-a338-a372ad4c2785 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:08.711085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0772abf7-e758-425e-a338-a372ad4c2785 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:08.719442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0772abf7-e758-425e-a338-a372ad4c2785 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:08.723703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0772abf7-e758-425e-a338-a372ad4c2785 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:08.724702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0772abf7-e758-425e-a338-a372ad4c2785 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:08.725167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0772abf7-e758-425e-a338-a372ad4c2785 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:08.955348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0772abf7-e758-425e-a338-a372ad4c2785 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:08.963778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0772abf7-e758-425e-a338-a372ad4c2785 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.256979 Jul 27 20:14:08.966517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 61/123] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:08 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:09.649645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-923c7cbb-b5a9-4a4e-82d0-9b373070f8b2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:09.650255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-923c7cbb-b5a9-4a4e-82d0-9b373070f8b2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:09.656174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-923c7cbb-b5a9-4a4e-82d0-9b373070f8b2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.656658 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-923c7cbb-b5a9-4a4e-82d0-9b373070f8b2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.657407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-923c7cbb-b5a9-4a4e-82d0-9b373070f8b2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.657936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-923c7cbb-b5a9-4a4e-82d0-9b373070f8b2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.695863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-556c5133-c6d3-4d84-8a47-9637e92b26b0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:09.697400 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-556c5133-c6d3-4d84-8a47-9637e92b26b0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:09.706195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-556c5133-c6d3-4d84-8a47-9637e92b26b0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.706986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-556c5133-c6d3-4d84-8a47-9637e92b26b0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.709386 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-556c5133-c6d3-4d84-8a47-9637e92b26b0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.709386 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-556c5133-c6d3-4d84-8a47-9637e92b26b0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.871354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-923c7cbb-b5a9-4a4e-82d0-9b373070f8b2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:09.879231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-923c7cbb-b5a9-4a4e-82d0-9b373070f8b2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1516 microversion: 2.1 time: 0.233973 Jul 27 20:14:09.879887 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 63/124] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:09 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:09.900433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-556c5133-c6d3-4d84-8a47-9637e92b26b0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:09.909872 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-556c5133-c6d3-4d84-8a47-9637e92b26b0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.220072 Jul 27 20:14:09.911600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e2390548-efb4-4e41-982a-85e165f628dc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:09.913943 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 62/125] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:09 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:09.915194 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e2390548-efb4-4e41-982a-85e165f628dc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:09.927615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2390548-efb4-4e41-982a-85e165f628dc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.928059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2390548-efb4-4e41-982a-85e165f628dc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.930070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2390548-efb4-4e41-982a-85e165f628dc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.930497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2390548-efb4-4e41-982a-85e165f628dc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.985213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-64387ddc-e4bc-46cf-b0d8-876343019370 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:09.986342 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-64387ddc-e4bc-46cf-b0d8-876343019370 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:09.994659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64387ddc-e4bc-46cf-b0d8-876343019370 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.995519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64387ddc-e4bc-46cf-b0d8-876343019370 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.996828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64387ddc-e4bc-46cf-b0d8-876343019370 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.997599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64387ddc-e4bc-46cf-b0d8-876343019370 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.999939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-e2390548-efb4-4e41-982a-85e165f628dc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lazy-loading 'flavor' on Instance uuid 982bde5c-b64d-40ee-aedf-9553303e1aef {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:14:10.146008 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-64387ddc-e4bc-46cf-b0d8-876343019370 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:10.153722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-64387ddc-e4bc-46cf-b0d8-876343019370 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.172562 Jul 27 20:14:10.154298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 63/126] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:09 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:10.293499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-825a4fa3-d8ac-4585-88fd-d23be5769596 req-36096c6e-71b3-4def-ad9c-db6ffa4a98ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4ea93-fe33-426a-aa16-4ecfa7521db5", "name": "network-vif-plugged", "status": "completed", "tag": "5583e13a-a514-4349-b84b-69d2a82f1085"}, {"server_uuid": "0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d", "name": "network-vif-plugged", "status": "completed", "tag": "84027fbb-9bf0-449e-88d5-f3164a9148a2"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:10.303716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-825a4fa3-d8ac-4585-88fd-d23be5769596 req-36096c6e-71b3-4def-ad9c-db6ffa4a98ec service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:10.304149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-825a4fa3-d8ac-4585-88fd-d23be5769596 req-36096c6e-71b3-4def-ad9c-db6ffa4a98ec service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:10.317902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-825a4fa3-d8ac-4585-88fd-d23be5769596 req-36096c6e-71b3-4def-ad9c-db6ffa4a98ec service nova] Creating event network-vif-plugged:5583e13a-a514-4349-b84b-69d2a82f1085 for instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 on hv-cinder-85124 Jul 27 20:14:10.318415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-825a4fa3-d8ac-4585-88fd-d23be5769596 req-36096c6e-71b3-4def-ad9c-db6ffa4a98ec service nova] Creating event network-vif-plugged:84027fbb-9bf0-449e-88d5-f3164a9148a2 for instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d on hv-cinder-85124 Jul 27 20:14:10.325411 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-825a4fa3-d8ac-4585-88fd-d23be5769596 req-36096c6e-71b3-4def-ad9c-db6ffa4a98ec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035648 Jul 27 20:14:10.326017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 64/127] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:14:10.392670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e2390548-efb4-4e41-982a-85e165f628dc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "POST /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef/action" status: 200 len: 32 microversion: 2.1 time: 0.491007 Jul 27 20:14:10.393296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 64/128] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:14:09 2022] POST /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef/action => generated 32 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:14:10.405267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-770bf482-49be-4226-a27e-ac5a81e5c840 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:10.405963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-770bf482-49be-4226-a27e-ac5a81e5c840 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:10.412456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-770bf482-49be-4226-a27e-ac5a81e5c840 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:10.412904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-770bf482-49be-4226-a27e-ac5a81e5c840 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:10.413703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-770bf482-49be-4226-a27e-ac5a81e5c840 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:10.414167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-770bf482-49be-4226-a27e-ac5a81e5c840 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:10.579828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-770bf482-49be-4226-a27e-ac5a81e5c840 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:10.587644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-770bf482-49be-4226-a27e-ac5a81e5c840 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.186525 Jul 27 20:14:10.588344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 65/129] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:10 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:10.936316 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4d913932-a9ac-403a-83be-8629f04b2404 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:10.937166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4d913932-a9ac-403a-83be-8629f04b2404 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:10.947400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d913932-a9ac-403a-83be-8629f04b2404 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:10.947988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d913932-a9ac-403a-83be-8629f04b2404 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:10.948881 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d913932-a9ac-403a-83be-8629f04b2404 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:10.949314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d913932-a9ac-403a-83be-8629f04b2404 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:11.087036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4d913932-a9ac-403a-83be-8629f04b2404 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:11.094434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4d913932-a9ac-403a-83be-8629f04b2404 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.162718 Jul 27 20:14:11.094997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 65/130] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:10 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:11.174612 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5a625a4b-9c8f-481d-a838-9f0f4e83ac48 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:11.175189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5a625a4b-9c8f-481d-a838-9f0f4e83ac48 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:11.182846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a625a4b-9c8f-481d-a838-9f0f4e83ac48 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:11.183295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a625a4b-9c8f-481d-a838-9f0f4e83ac48 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:11.184047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a625a4b-9c8f-481d-a838-9f0f4e83ac48 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:11.184622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a625a4b-9c8f-481d-a838-9f0f4e83ac48 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:11.343803 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5a625a4b-9c8f-481d-a838-9f0f4e83ac48 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:11.352819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5a625a4b-9c8f-481d-a838-9f0f4e83ac48 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.182074 Jul 27 20:14:11.353409 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 66/131] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:11 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:11.608358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d7c90af6-c098-40e3-8d03-7e40b29609fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:11.609056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d7c90af6-c098-40e3-8d03-7e40b29609fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:11.615684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d7c90af6-c098-40e3-8d03-7e40b29609fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:11.616307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d7c90af6-c098-40e3-8d03-7e40b29609fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:11.621297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d7c90af6-c098-40e3-8d03-7e40b29609fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:11.621297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d7c90af6-c098-40e3-8d03-7e40b29609fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:11.755037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d7c90af6-c098-40e3-8d03-7e40b29609fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:11.764249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d7c90af6-c098-40e3-8d03-7e40b29609fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.159636 Jul 27 20:14:11.765176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 66/132] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:11 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:12.114506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-637d8c7b-59c5-4cd2-8b57-bbd2a57d8143 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:12.115254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-637d8c7b-59c5-4cd2-8b57-bbd2a57d8143 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:12.121611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637d8c7b-59c5-4cd2-8b57-bbd2a57d8143 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:12.122157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637d8c7b-59c5-4cd2-8b57-bbd2a57d8143 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:12.123075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637d8c7b-59c5-4cd2-8b57-bbd2a57d8143 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:12.123600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637d8c7b-59c5-4cd2-8b57-bbd2a57d8143 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:12.265184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-637d8c7b-59c5-4cd2-8b57-bbd2a57d8143 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:12.272665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-637d8c7b-59c5-4cd2-8b57-bbd2a57d8143 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.162166 Jul 27 20:14:12.273807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 67/133] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:12 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:12.374144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e82da60-896d-43fa-a6da-bd9ef595be93 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:12.374755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7e82da60-896d-43fa-a6da-bd9ef595be93 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:12.381975 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e82da60-896d-43fa-a6da-bd9ef595be93 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:12.383758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e82da60-896d-43fa-a6da-bd9ef595be93 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:12.384742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e82da60-896d-43fa-a6da-bd9ef595be93 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:12.385475 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e82da60-896d-43fa-a6da-bd9ef595be93 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:12.529357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7e82da60-896d-43fa-a6da-bd9ef595be93 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:12.537379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7e82da60-896d-43fa-a6da-bd9ef595be93 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.167061 Jul 27 20:14:12.537953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 67/134] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:12 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:12.786300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-28dbf041-91f5-4598-8e2f-bfeef380dad2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:12.787292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-28dbf041-91f5-4598-8e2f-bfeef380dad2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:12.794769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28dbf041-91f5-4598-8e2f-bfeef380dad2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:12.795399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28dbf041-91f5-4598-8e2f-bfeef380dad2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:12.796501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28dbf041-91f5-4598-8e2f-bfeef380dad2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:12.796944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28dbf041-91f5-4598-8e2f-bfeef380dad2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:12.942187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-28dbf041-91f5-4598-8e2f-bfeef380dad2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:12.953017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-28dbf041-91f5-4598-8e2f-bfeef380dad2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.169841 Jul 27 20:14:12.958563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 68/135] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:12 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:13.294112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5be91273-baab-4770-814c-1c559667d4f1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:13.294740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5be91273-baab-4770-814c-1c559667d4f1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:13.301870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5be91273-baab-4770-814c-1c559667d4f1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:13.302348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5be91273-baab-4770-814c-1c559667d4f1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:13.303207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5be91273-baab-4770-814c-1c559667d4f1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:13.303642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5be91273-baab-4770-814c-1c559667d4f1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:13.439719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5be91273-baab-4770-814c-1c559667d4f1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:13.447496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5be91273-baab-4770-814c-1c559667d4f1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.157243 Jul 27 20:14:13.448073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 68/136] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:13 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:13.564947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c4c3ee9d-d72a-4b2f-90cc-50a2ebeb44b7 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:13.565533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c4c3ee9d-d72a-4b2f-90cc-50a2ebeb44b7 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:13.572531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4c3ee9d-d72a-4b2f-90cc-50a2ebeb44b7 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:13.573060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4c3ee9d-d72a-4b2f-90cc-50a2ebeb44b7 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:13.574113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4c3ee9d-d72a-4b2f-90cc-50a2ebeb44b7 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:13.574576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4c3ee9d-d72a-4b2f-90cc-50a2ebeb44b7 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:13.715369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c4c3ee9d-d72a-4b2f-90cc-50a2ebeb44b7 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:13.726277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c4c3ee9d-d72a-4b2f-90cc-50a2ebeb44b7 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.165132 Jul 27 20:14:13.726857 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 69/137] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:13 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:13.973802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c9a27db9-920f-45e3-b29f-884ea98eb0a0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:13.974349 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c9a27db9-920f-45e3-b29f-884ea98eb0a0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:13.980196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9a27db9-920f-45e3-b29f-884ea98eb0a0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:13.980673 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9a27db9-920f-45e3-b29f-884ea98eb0a0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:13.981433 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9a27db9-920f-45e3-b29f-884ea98eb0a0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:13.981866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9a27db9-920f-45e3-b29f-884ea98eb0a0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:14.110667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c9a27db9-920f-45e3-b29f-884ea98eb0a0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:14.118729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c9a27db9-920f-45e3-b29f-884ea98eb0a0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.148774 Jul 27 20:14:14.119571 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 69/138] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:13 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:14.469998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a5caa999-9901-4c85-9397-4812fe76be2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:14.470608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a5caa999-9901-4c85-9397-4812fe76be2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:14.477109 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5caa999-9901-4c85-9397-4812fe76be2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:14.477764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5caa999-9901-4c85-9397-4812fe76be2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:14.478475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5caa999-9901-4c85-9397-4812fe76be2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:14.478908 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5caa999-9901-4c85-9397-4812fe76be2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:14.616136 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a5caa999-9901-4c85-9397-4812fe76be2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:14.624721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a5caa999-9901-4c85-9397-4812fe76be2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.158398 Jul 27 20:14:14.625298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 70/139] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:14 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:14.747659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0ee7e191-f721-449c-97e1-6452a712cf58 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:14.748269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0ee7e191-f721-449c-97e1-6452a712cf58 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:14.754396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ee7e191-f721-449c-97e1-6452a712cf58 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:14.754911 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ee7e191-f721-449c-97e1-6452a712cf58 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:14.755708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ee7e191-f721-449c-97e1-6452a712cf58 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:14.756144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ee7e191-f721-449c-97e1-6452a712cf58 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:14.881408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0ee7e191-f721-449c-97e1-6452a712cf58 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:14.889399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0ee7e191-f721-449c-97e1-6452a712cf58 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.145901 Jul 27 20:14:14.890061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 70/140] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:14 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:15.139085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-06ac6e51-1ba8-4d28-b3bd-b1ffd341f229 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:15.139689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-06ac6e51-1ba8-4d28-b3bd-b1ffd341f229 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:15.145671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-06ac6e51-1ba8-4d28-b3bd-b1ffd341f229 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:15.150133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-06ac6e51-1ba8-4d28-b3bd-b1ffd341f229 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:15.150133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-06ac6e51-1ba8-4d28-b3bd-b1ffd341f229 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:15.150133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-06ac6e51-1ba8-4d28-b3bd-b1ffd341f229 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:15.277733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-06ac6e51-1ba8-4d28-b3bd-b1ffd341f229 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:15.285096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-06ac6e51-1ba8-4d28-b3bd-b1ffd341f229 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.149886 Jul 27 20:14:15.285671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 71/141] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:15 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:15.645249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e17257aa-1765-4349-8179-938152595dee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:15.645866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e17257aa-1765-4349-8179-938152595dee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:15.652333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e17257aa-1765-4349-8179-938152595dee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:15.652854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e17257aa-1765-4349-8179-938152595dee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:15.653630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e17257aa-1765-4349-8179-938152595dee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:15.654046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e17257aa-1765-4349-8179-938152595dee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:15.783863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e17257aa-1765-4349-8179-938152595dee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:15.792036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e17257aa-1765-4349-8179-938152595dee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.150573 Jul 27 20:14:15.792650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 71/142] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:15 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:15.910688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-54f94cdf-24cd-4f7d-a61e-d42f67130598 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:15.912400 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-54f94cdf-24cd-4f7d-a61e-d42f67130598 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:15.920476 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54f94cdf-24cd-4f7d-a61e-d42f67130598 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:15.921068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54f94cdf-24cd-4f7d-a61e-d42f67130598 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:15.921843 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54f94cdf-24cd-4f7d-a61e-d42f67130598 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:15.922733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54f94cdf-24cd-4f7d-a61e-d42f67130598 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:16.227426 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-54f94cdf-24cd-4f7d-a61e-d42f67130598 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:16.235314 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-54f94cdf-24cd-4f7d-a61e-d42f67130598 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1315 microversion: 2.1 time: 0.328701 Jul 27 20:14:16.235959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 72/143] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:15 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:16.306299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0d5b519a-bce7-490d-8a15-0e3aac5dbcf7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:16.306915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0d5b519a-bce7-490d-8a15-0e3aac5dbcf7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:16.312862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d5b519a-bce7-490d-8a15-0e3aac5dbcf7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:16.313305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d5b519a-bce7-490d-8a15-0e3aac5dbcf7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:16.314051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d5b519a-bce7-490d-8a15-0e3aac5dbcf7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:16.314479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d5b519a-bce7-490d-8a15-0e3aac5dbcf7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:16.442591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d5b519a-bce7-490d-8a15-0e3aac5dbcf7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:16.450607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0d5b519a-bce7-490d-8a15-0e3aac5dbcf7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.148305 Jul 27 20:14:16.451178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 72/144] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:16 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:16.813243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9fe722c1-cdef-4067-8722-930681bec06e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:16.813636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9fe722c1-cdef-4067-8722-930681bec06e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:16.819530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fe722c1-cdef-4067-8722-930681bec06e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:16.820036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fe722c1-cdef-4067-8722-930681bec06e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:16.821132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fe722c1-cdef-4067-8722-930681bec06e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:16.821625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fe722c1-cdef-4067-8722-930681bec06e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:16.951597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9fe722c1-cdef-4067-8722-930681bec06e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:16.959011 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9fe722c1-cdef-4067-8722-930681bec06e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.149895 Jul 27 20:14:16.959568 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 73/145] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:16 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:17.256719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-82b96898-e7e0-44ef-9554-c53c3a0061b3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:17.257833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-82b96898-e7e0-44ef-9554-c53c3a0061b3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:17.263854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82b96898-e7e0-44ef-9554-c53c3a0061b3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:17.264300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82b96898-e7e0-44ef-9554-c53c3a0061b3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:17.265091 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82b96898-e7e0-44ef-9554-c53c3a0061b3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:17.265522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82b96898-e7e0-44ef-9554-c53c3a0061b3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:17.396434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-82b96898-e7e0-44ef-9554-c53c3a0061b3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:17.400578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:17.404870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-82b96898-e7e0-44ef-9554-c53c3a0061b3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1502 microversion: 2.1 time: 0.152088 Jul 27 20:14:17.405441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 73/146] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:17 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:17.471005 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1158538e-c625-44f3-996a-ca3c0fbec482 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:17.471724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1158538e-c625-44f3-996a-ca3c0fbec482 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:17.478521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1158538e-c625-44f3-996a-ca3c0fbec482 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:17.488445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1158538e-c625-44f3-996a-ca3c0fbec482 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:17.488445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1158538e-c625-44f3-996a-ca3c0fbec482 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:17.488445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1158538e-c625-44f3-996a-ca3c0fbec482 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:17.609801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1158538e-c625-44f3-996a-ca3c0fbec482 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:17.618377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1158538e-c625-44f3-996a-ca3c0fbec482 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.151152 Jul 27 20:14:17.619204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 74/147] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:17 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:17.983033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b5a6ea61-4570-448e-8543-535f647d2cf7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:17.983033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b5a6ea61-4570-448e-8543-535f647d2cf7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:17.988203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b5a6ea61-4570-448e-8543-535f647d2cf7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:17.988771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b5a6ea61-4570-448e-8543-535f647d2cf7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:17.989615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b5a6ea61-4570-448e-8543-535f647d2cf7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:17.990054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b5a6ea61-4570-448e-8543-535f647d2cf7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:18.125153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b5a6ea61-4570-448e-8543-535f647d2cf7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:18.133615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b5a6ea61-4570-448e-8543-535f647d2cf7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.157985 Jul 27 20:14:18.134215 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 74/148] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:17 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:18.639544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8d97ae8e-9d79-4a54-b767-d980b55291d9 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:18.640062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8d97ae8e-9d79-4a54-b767-d980b55291d9 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:18.646151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d97ae8e-9d79-4a54-b767-d980b55291d9 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:18.646585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d97ae8e-9d79-4a54-b767-d980b55291d9 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:18.647319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d97ae8e-9d79-4a54-b767-d980b55291d9 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:18.647792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d97ae8e-9d79-4a54-b767-d980b55291d9 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:18.774349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8d97ae8e-9d79-4a54-b767-d980b55291d9 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:18.781643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8d97ae8e-9d79-4a54-b767-d980b55291d9 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.146021 Jul 27 20:14:18.782211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 75/149] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:18 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:19.154763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-68877187-c3d1-425a-9eed-c5da39be818c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:19.155378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-68877187-c3d1-425a-9eed-c5da39be818c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:19.157221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:19.164706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68877187-c3d1-425a-9eed-c5da39be818c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:19.164706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68877187-c3d1-425a-9eed-c5da39be818c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:19.164706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68877187-c3d1-425a-9eed-c5da39be818c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:19.164706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68877187-c3d1-425a-9eed-c5da39be818c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:19.297442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-68877187-c3d1-425a-9eed-c5da39be818c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:19.305568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-68877187-c3d1-425a-9eed-c5da39be818c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.154966 Jul 27 20:14:19.306139 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 75/150] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:19 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:19.803193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-842f42fc-5a07-4765-a9f7-b97ac4dd9adc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:19.804751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-842f42fc-5a07-4765-a9f7-b97ac4dd9adc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:19.810158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-842f42fc-5a07-4765-a9f7-b97ac4dd9adc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:19.810598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-842f42fc-5a07-4765-a9f7-b97ac4dd9adc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:19.811340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-842f42fc-5a07-4765-a9f7-b97ac4dd9adc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:19.811758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-842f42fc-5a07-4765-a9f7-b97ac4dd9adc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:19.826433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:19.941591 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-842f42fc-5a07-4765-a9f7-b97ac4dd9adc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:19.949442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-842f42fc-5a07-4765-a9f7-b97ac4dd9adc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.150435 Jul 27 20:14:19.949943 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 76/151] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:19 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:20.326429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7bb3e5fd-ee4c-44a7-95d8-748797c31d65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:20.327104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7bb3e5fd-ee4c-44a7-95d8-748797c31d65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:20.333347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bb3e5fd-ee4c-44a7-95d8-748797c31d65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:20.333797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bb3e5fd-ee4c-44a7-95d8-748797c31d65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:20.334568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bb3e5fd-ee4c-44a7-95d8-748797c31d65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:20.335097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bb3e5fd-ee4c-44a7-95d8-748797c31d65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:20.469073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7bb3e5fd-ee4c-44a7-95d8-748797c31d65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:20.476663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7bb3e5fd-ee4c-44a7-95d8-748797c31d65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.154210 Jul 27 20:14:20.477461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 76/152] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:20 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:20.969913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bf816414-42c5-44e0-9bff-6b1c9a6f613f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:20.970521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bf816414-42c5-44e0-9bff-6b1c9a6f613f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:20.976988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf816414-42c5-44e0-9bff-6b1c9a6f613f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:20.977432 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf816414-42c5-44e0-9bff-6b1c9a6f613f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:20.978188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf816414-42c5-44e0-9bff-6b1c9a6f613f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:20.978615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf816414-42c5-44e0-9bff-6b1c9a6f613f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:21.111751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bf816414-42c5-44e0-9bff-6b1c9a6f613f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:21.120742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bf816414-42c5-44e0-9bff-6b1c9a6f613f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.154576 Jul 27 20:14:21.124415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 77/153] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:20 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:21.497619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1df40a3c-e28e-4746-9ab2-7616ac7bd3ab tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:21.498228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1df40a3c-e28e-4746-9ab2-7616ac7bd3ab tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:21.504439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1df40a3c-e28e-4746-9ab2-7616ac7bd3ab tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:21.504890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1df40a3c-e28e-4746-9ab2-7616ac7bd3ab tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:21.505695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1df40a3c-e28e-4746-9ab2-7616ac7bd3ab tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:21.506275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1df40a3c-e28e-4746-9ab2-7616ac7bd3ab tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:21.643508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1df40a3c-e28e-4746-9ab2-7616ac7bd3ab tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:21.651496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1df40a3c-e28e-4746-9ab2-7616ac7bd3ab tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.157991 Jul 27 20:14:21.652102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 77/154] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:21 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:22.143556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fc14b4d8-283f-45e9-8713-ba9c25b859de tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:22.144178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fc14b4d8-283f-45e9-8713-ba9c25b859de tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:22.150450 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc14b4d8-283f-45e9-8713-ba9c25b859de tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:22.150930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc14b4d8-283f-45e9-8713-ba9c25b859de tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:22.151752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc14b4d8-283f-45e9-8713-ba9c25b859de tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:22.152185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc14b4d8-283f-45e9-8713-ba9c25b859de tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:22.280499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fc14b4d8-283f-45e9-8713-ba9c25b859de tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:22.287868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fc14b4d8-283f-45e9-8713-ba9c25b859de tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.148185 Jul 27 20:14:22.288456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 78/155] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:22 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:22.672361 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1176a54e-bcd1-4e10-b374-b21cf2a76d8f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:22.672990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1176a54e-bcd1-4e10-b374-b21cf2a76d8f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:22.679531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1176a54e-bcd1-4e10-b374-b21cf2a76d8f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:22.679978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1176a54e-bcd1-4e10-b374-b21cf2a76d8f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:22.680761 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1176a54e-bcd1-4e10-b374-b21cf2a76d8f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:22.681193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1176a54e-bcd1-4e10-b374-b21cf2a76d8f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:22.803615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1176a54e-bcd1-4e10-b374-b21cf2a76d8f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:22.811513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1176a54e-bcd1-4e10-b374-b21cf2a76d8f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.142921 Jul 27 20:14:22.812080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 78/156] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:22 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:23.308287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d770161c-aca1-4732-884d-f47b59880287 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:23.308861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d770161c-aca1-4732-884d-f47b59880287 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:23.314784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d770161c-aca1-4732-884d-f47b59880287 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:23.315225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d770161c-aca1-4732-884d-f47b59880287 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:23.315972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d770161c-aca1-4732-884d-f47b59880287 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:23.316421 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d770161c-aca1-4732-884d-f47b59880287 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:23.705246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d770161c-aca1-4732-884d-f47b59880287 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:23.705246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d770161c-aca1-4732-884d-f47b59880287 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.154109 Jul 27 20:14:23.705246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 79/157] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:23 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:23.832692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5c26ec63-3461-4d22-bde1-2dbacb4e465a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:23.834038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5c26ec63-3461-4d22-bde1-2dbacb4e465a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:23.841252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c26ec63-3461-4d22-bde1-2dbacb4e465a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:23.841787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c26ec63-3461-4d22-bde1-2dbacb4e465a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:23.842984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c26ec63-3461-4d22-bde1-2dbacb4e465a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:23.843618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c26ec63-3461-4d22-bde1-2dbacb4e465a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:23.990976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c26ec63-3461-4d22-bde1-2dbacb4e465a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:23.998804 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5c26ec63-3461-4d22-bde1-2dbacb4e465a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1362 microversion: 2.1 time: 0.171235 Jul 27 20:14:23.999387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 79/158] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:23 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:24.496025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-38f53683-e381-49da-bec4-6758c1f0e34d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:24.496644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-38f53683-e381-49da-bec4-6758c1f0e34d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:24.503590 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38f53683-e381-49da-bec4-6758c1f0e34d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:24.504192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38f53683-e381-49da-bec4-6758c1f0e34d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:24.505060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38f53683-e381-49da-bec4-6758c1f0e34d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:24.505525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38f53683-e381-49da-bec4-6758c1f0e34d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:24.650234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-38f53683-e381-49da-bec4-6758c1f0e34d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:24.658635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-38f53683-e381-49da-bec4-6758c1f0e34d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.167310 Jul 27 20:14:24.664422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 80/159] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:24 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:24.771760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a78ef388-651c-4494-a7a5-25031109469e tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adecbd37-16cc-460d-9c28-689f5c74131d"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:24.776620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a78ef388-651c-4494-a7a5-25031109469e tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:24.783468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a78ef388-651c-4494-a7a5-25031109469e tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:24.784099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a78ef388-651c-4494-a7a5-25031109469e tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:24.784914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a78ef388-651c-4494-a7a5-25031109469e tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:24.785349 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a78ef388-651c-4494-a7a5-25031109469e tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:25.020130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8c12e280-968c-4404-8005-019cfdfec272 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:25.020712 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8c12e280-968c-4404-8005-019cfdfec272 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:25.027061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c12e280-968c-4404-8005-019cfdfec272 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:25.027504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c12e280-968c-4404-8005-019cfdfec272 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:25.028291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c12e280-968c-4404-8005-019cfdfec272 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:25.028805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c12e280-968c-4404-8005-019cfdfec272 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:25.215948 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8c12e280-968c-4404-8005-019cfdfec272 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:25.227090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8c12e280-968c-4404-8005-019cfdfec272 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1548 microversion: 2.1 time: 0.210743 Jul 27 20:14:25.232016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 81/160] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:25 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:25.252595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2a49e521-1eb5-4b8f-9c59-7e6ff4a67610 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:25.253205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2a49e521-1eb5-4b8f-9c59-7e6ff4a67610 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:25.260706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a49e521-1eb5-4b8f-9c59-7e6ff4a67610 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:25.261328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a49e521-1eb5-4b8f-9c59-7e6ff4a67610 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:25.262247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a49e521-1eb5-4b8f-9c59-7e6ff4a67610 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:25.263324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a49e521-1eb5-4b8f-9c59-7e6ff4a67610 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:25.405200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2a49e521-1eb5-4b8f-9c59-7e6ff4a67610 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158843 Jul 27 20:14:25.405796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 82/161] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 20:14:25 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:14:25.681461 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-25a75720-27b8-4c3c-88d6-00c212044d89 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:25.681982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-25a75720-27b8-4c3c-88d6-00c212044d89 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:25.688769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25a75720-27b8-4c3c-88d6-00c212044d89 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:25.689216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25a75720-27b8-4c3c-88d6-00c212044d89 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:25.690184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25a75720-27b8-4c3c-88d6-00c212044d89 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:25.690614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25a75720-27b8-4c3c-88d6-00c212044d89 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:26.042148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-25a75720-27b8-4c3c-88d6-00c212044d89 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:26.051318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-25a75720-27b8-4c3c-88d6-00c212044d89 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.375151 Jul 27 20:14:26.054422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 83/162] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:25 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:26.254657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a78ef388-651c-4494-a7a5-25031109469e tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "POST /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.489194 Jul 27 20:14:26.255386 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 80/163] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:14:24 2022] POST /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122/os-volume_attachments => generated 194 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:14:27.071769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d6ae0765-be97-47ea-82f7-9947657f1b4b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:27.073010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d6ae0765-be97-47ea-82f7-9947657f1b4b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:27.074979 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=86 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:27.080180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6ae0765-be97-47ea-82f7-9947657f1b4b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:27.080734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6ae0765-be97-47ea-82f7-9947657f1b4b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:27.081578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6ae0765-be97-47ea-82f7-9947657f1b4b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:27.082077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6ae0765-be97-47ea-82f7-9947657f1b4b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:27.445289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d6ae0765-be97-47ea-82f7-9947657f1b4b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:27.456799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d6ae0765-be97-47ea-82f7-9947657f1b4b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.388793 Jul 27 20:14:27.476483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 84/164] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:27 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:27.643735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-b8439a7f-ede0-4bb7-b9fe-e3e3df5bf63b req-a7626920-bbd6-44f5-83e9-bdb228eecf14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d", "tag": "84027fbb-9bf0-449e-88d5-f3164a9148a2"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:27.655275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=74 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:27.657644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-b8439a7f-ede0-4bb7-b9fe-e3e3df5bf63b req-a7626920-bbd6-44f5-83e9-bdb228eecf14 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:27.658301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-b8439a7f-ede0-4bb7-b9fe-e3e3df5bf63b req-a7626920-bbd6-44f5-83e9-bdb228eecf14 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:27.673852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-b8439a7f-ede0-4bb7-b9fe-e3e3df5bf63b req-a7626920-bbd6-44f5-83e9-bdb228eecf14 service nova] Creating event network-changed:84027fbb-9bf0-449e-88d5-f3164a9148a2 for instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d on hv-cinder-85124 Jul 27 20:14:27.679839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-b8439a7f-ede0-4bb7-b9fe-e3e3df5bf63b req-a7626920-bbd6-44f5-83e9-bdb228eecf14 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042356 Jul 27 20:14:27.683833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 81/165] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:14:28.479023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2b52ad6b-bee8-400f-8f57-5ef7d6fbc7e3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:28.479858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2b52ad6b-bee8-400f-8f57-5ef7d6fbc7e3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:28.490470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b52ad6b-bee8-400f-8f57-5ef7d6fbc7e3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:28.490470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b52ad6b-bee8-400f-8f57-5ef7d6fbc7e3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:28.490470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b52ad6b-bee8-400f-8f57-5ef7d6fbc7e3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:28.490470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b52ad6b-bee8-400f-8f57-5ef7d6fbc7e3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:28.640916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2b52ad6b-bee8-400f-8f57-5ef7d6fbc7e3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:28.649327 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2b52ad6b-bee8-400f-8f57-5ef7d6fbc7e3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.174646 Jul 27 20:14:28.649927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 85/166] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:28 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:29.671923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e0adbc41-8c6d-46f0-a1f7-7aefdc3f384c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:29.672649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e0adbc41-8c6d-46f0-a1f7-7aefdc3f384c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:29.680026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e0adbc41-8c6d-46f0-a1f7-7aefdc3f384c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:29.680499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e0adbc41-8c6d-46f0-a1f7-7aefdc3f384c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:29.681246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e0adbc41-8c6d-46f0-a1f7-7aefdc3f384c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:29.681673 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e0adbc41-8c6d-46f0-a1f7-7aefdc3f384c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:29.812668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e0adbc41-8c6d-46f0-a1f7-7aefdc3f384c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:29.823118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e0adbc41-8c6d-46f0-a1f7-7aefdc3f384c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.155650 Jul 27 20:14:29.826104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 82/167] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:29 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:30.847757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-156410c7-158a-45ae-aa78-55238550ed6b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:30.848365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-156410c7-158a-45ae-aa78-55238550ed6b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:30.854974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-156410c7-158a-45ae-aa78-55238550ed6b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:30.855421 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-156410c7-158a-45ae-aa78-55238550ed6b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:30.856191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-156410c7-158a-45ae-aa78-55238550ed6b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:30.856652 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-156410c7-158a-45ae-aa78-55238550ed6b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:31.040950 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-156410c7-158a-45ae-aa78-55238550ed6b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:31.049227 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-156410c7-158a-45ae-aa78-55238550ed6b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.205837 Jul 27 20:14:31.050298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 86/168] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:30 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:32.074205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-68e34eb8-109d-4f21-9a01-0989ac8f049d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:32.074821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-68e34eb8-109d-4f21-9a01-0989ac8f049d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:32.081425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68e34eb8-109d-4f21-9a01-0989ac8f049d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:32.081877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68e34eb8-109d-4f21-9a01-0989ac8f049d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:32.082697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68e34eb8-109d-4f21-9a01-0989ac8f049d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:32.083132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68e34eb8-109d-4f21-9a01-0989ac8f049d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:32.225820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-68e34eb8-109d-4f21-9a01-0989ac8f049d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:32.233297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-68e34eb8-109d-4f21-9a01-0989ac8f049d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.162885 Jul 27 20:14:32.233859 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 83/169] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:32 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:32.379088 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1100775077", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "networks": [{"uuid": "af698b61-79e3-453b-8e69-bec8a017326f"}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:32.430459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] validate_networks() for [('af698b61-79e3-453b-8e69-bec8a017326f', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:14:32.780523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:14:32.780977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:14:32.781466 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:14:32.781895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:14:32.782297 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:14:32.793282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:32.793720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:32.794530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:32.794980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:32.811221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Getting quotas for project 8054a20f70e6408ebe06c787887d0b16. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:14:32.815182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Getting quotas for user 8f2d8cdf0e0d48f4a89a0e85694c3372 and project 8054a20f70e6408ebe06c787887d0b16. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:14:32.825943 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:14:32.829479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:14:33.017445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2627f2a1-9329-4c41-b093-6bc4d45c0067 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641441 Jul 27 20:14:33.018135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 87/170] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:14:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:14:33.029824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-047d2db4-9d88-430e-9323-760daa02346c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:33.030812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-047d2db4-9d88-430e-9323-760daa02346c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:33.092890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-047d2db4-9d88-430e-9323-760daa02346c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:33.100127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-047d2db4-9d88-430e-9323-760daa02346c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1219 microversion: 2.1 time: 0.074199 Jul 27 20:14:33.111255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 84/171] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:33 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:33.255013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c595ccc5-f135-40e5-8f21-d349c746aff6 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:33.255798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c595ccc5-f135-40e5-8f21-d349c746aff6 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:33.262151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c595ccc5-f135-40e5-8f21-d349c746aff6 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:33.267176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c595ccc5-f135-40e5-8f21-d349c746aff6 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:33.267176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c595ccc5-f135-40e5-8f21-d349c746aff6 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:33.267176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c595ccc5-f135-40e5-8f21-d349c746aff6 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:33.403410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c595ccc5-f135-40e5-8f21-d349c746aff6 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:33.412326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c595ccc5-f135-40e5-8f21-d349c746aff6 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.161134 Jul 27 20:14:33.413597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 88/172] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:33 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:34.126611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6e065a95-3f52-4e69-a4a3-a90ab68fe381 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:34.127301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6e065a95-3f52-4e69-a4a3-a90ab68fe381 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:34.224308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6e065a95-3f52-4e69-a4a3-a90ab68fe381 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:34.253707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6e065a95-3f52-4e69-a4a3-a90ab68fe381 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1219 microversion: 2.1 time: 0.114151 Jul 27 20:14:34.270914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 85/173] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:34 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:34.439555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a493afaa-8a80-4e92-acfe-5502bdc4bed0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:34.443624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a493afaa-8a80-4e92-acfe-5502bdc4bed0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:34.448865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a493afaa-8a80-4e92-acfe-5502bdc4bed0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:34.452176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a493afaa-8a80-4e92-acfe-5502bdc4bed0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:34.454091 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a493afaa-8a80-4e92-acfe-5502bdc4bed0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:34.455580 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a493afaa-8a80-4e92-acfe-5502bdc4bed0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:34.612291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a493afaa-8a80-4e92-acfe-5502bdc4bed0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:34.620860 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a493afaa-8a80-4e92-acfe-5502bdc4bed0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.189288 Jul 27 20:14:34.621453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 89/174] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:34 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:35.279389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8658ce03-2f58-463a-a39b-4acf1f8b69ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:35.280003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8658ce03-2f58-463a-a39b-4acf1f8b69ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:35.290174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8658ce03-2f58-463a-a39b-4acf1f8b69ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:35.290882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8658ce03-2f58-463a-a39b-4acf1f8b69ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:35.292023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8658ce03-2f58-463a-a39b-4acf1f8b69ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:35.292906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8658ce03-2f58-463a-a39b-4acf1f8b69ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:35.368525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8658ce03-2f58-463a-a39b-4acf1f8b69ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:35.373913 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8658ce03-2f58-463a-a39b-4acf1f8b69ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1271 microversion: 2.1 time: 0.098736 Jul 27 20:14:35.374582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 86/175] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:35 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:35.641851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c5ecbced-5447-4eeb-9251-6b08eb4221a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:35.642535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c5ecbced-5447-4eeb-9251-6b08eb4221a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:35.648446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5ecbced-5447-4eeb-9251-6b08eb4221a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:35.648865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5ecbced-5447-4eeb-9251-6b08eb4221a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:35.649637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5ecbced-5447-4eeb-9251-6b08eb4221a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:35.650059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5ecbced-5447-4eeb-9251-6b08eb4221a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:35.805839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c5ecbced-5447-4eeb-9251-6b08eb4221a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:35.816773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c5ecbced-5447-4eeb-9251-6b08eb4221a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.178634 Jul 27 20:14:35.817907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 90/176] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:35 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:36.407212 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf14737d-3f21-43fe-86e3-3722bdee1f19 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:36.408484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf14737d-3f21-43fe-86e3-3722bdee1f19 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:36.418551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf14737d-3f21-43fe-86e3-3722bdee1f19 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:36.419317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf14737d-3f21-43fe-86e3-3722bdee1f19 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:36.419990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf14737d-3f21-43fe-86e3-3722bdee1f19 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:36.421141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf14737d-3f21-43fe-86e3-3722bdee1f19 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:36.534938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf14737d-3f21-43fe-86e3-3722bdee1f19 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:36.542533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf14737d-3f21-43fe-86e3-3722bdee1f19 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1277 microversion: 2.1 time: 0.142092 Jul 27 20:14:36.550859 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 87/177] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:36 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:36.838947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f71e855a-4482-4069-a4f8-6c445b0b41da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:36.839548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f71e855a-4482-4069-a4f8-6c445b0b41da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:36.845610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f71e855a-4482-4069-a4f8-6c445b0b41da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:36.846051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f71e855a-4482-4069-a4f8-6c445b0b41da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:36.846929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f71e855a-4482-4069-a4f8-6c445b0b41da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:36.847351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f71e855a-4482-4069-a4f8-6c445b0b41da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:37.046062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f71e855a-4482-4069-a4f8-6c445b0b41da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:37.055880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f71e855a-4482-4069-a4f8-6c445b0b41da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.220370 Jul 27 20:14:37.056541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 91/178] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:36 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:37.564925 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-93af76c5-1664-4052-937b-6595bfe19e49 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:37.565622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-93af76c5-1664-4052-937b-6595bfe19e49 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:37.573149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93af76c5-1664-4052-937b-6595bfe19e49 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:37.573675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93af76c5-1664-4052-937b-6595bfe19e49 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:37.574711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93af76c5-1664-4052-937b-6595bfe19e49 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:37.575255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93af76c5-1664-4052-937b-6595bfe19e49 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:37.768299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-93af76c5-1664-4052-937b-6595bfe19e49 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:37.776061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-93af76c5-1664-4052-937b-6595bfe19e49 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.215613 Jul 27 20:14:37.776876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 88/179] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:37 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:37.913027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-ab389d9a-6f22-4b2c-82ea-a06ef3fad24a req-536ace08-2ec7-40c3-aa5f-ea159b7bf1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb47bd6-9456-46c6-b16a-552336fc32c4", "tag": "1f6b19f5-9290-4aaf-aa9c-8d8f8744dd6a"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:37.938660 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-ab389d9a-6f22-4b2c-82ea-a06ef3fad24a req-536ace08-2ec7-40c3-aa5f-ea159b7bf1d2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:37.939215 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-ab389d9a-6f22-4b2c-82ea-a06ef3fad24a req-536ace08-2ec7-40c3-aa5f-ea159b7bf1d2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:37.955188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-ab389d9a-6f22-4b2c-82ea-a06ef3fad24a req-536ace08-2ec7-40c3-aa5f-ea159b7bf1d2 service nova] Creating event network-changed:1f6b19f5-9290-4aaf-aa9c-8d8f8744dd6a for instance 0eb47bd6-9456-46c6-b16a-552336fc32c4 on hv-cinder-85124 Jul 27 20:14:37.961765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-ab389d9a-6f22-4b2c-82ea-a06ef3fad24a req-536ace08-2ec7-40c3-aa5f-ea159b7bf1d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066693 Jul 27 20:14:37.964132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 92/180] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:14:38.078234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c24eb7ca-5e83-4294-8c9a-9a6c34997533 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:38.079087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c24eb7ca-5e83-4294-8c9a-9a6c34997533 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:38.086019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c24eb7ca-5e83-4294-8c9a-9a6c34997533 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:38.086702 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c24eb7ca-5e83-4294-8c9a-9a6c34997533 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:38.087870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c24eb7ca-5e83-4294-8c9a-9a6c34997533 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:38.088524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c24eb7ca-5e83-4294-8c9a-9a6c34997533 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:38.617810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c24eb7ca-5e83-4294-8c9a-9a6c34997533 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:38.627637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c24eb7ca-5e83-4294-8c9a-9a6c34997533 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.553530 Jul 27 20:14:38.642743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 89/181] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:38 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:38.798874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cba4676b-a3cd-4fdc-946a-8d9070aea517 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:38.799869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cba4676b-a3cd-4fdc-946a-8d9070aea517 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:38.807746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cba4676b-a3cd-4fdc-946a-8d9070aea517 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:38.808501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cba4676b-a3cd-4fdc-946a-8d9070aea517 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:38.809614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cba4676b-a3cd-4fdc-946a-8d9070aea517 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:38.810861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cba4676b-a3cd-4fdc-946a-8d9070aea517 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:38.995605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cba4676b-a3cd-4fdc-946a-8d9070aea517 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:39.008555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cba4676b-a3cd-4fdc-946a-8d9070aea517 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.214548 Jul 27 20:14:39.010027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 93/182] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:38 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:39.650443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0ec1f77b-37d0-4368-be1a-9a2ea4c23522 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:39.651054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0ec1f77b-37d0-4368-be1a-9a2ea4c23522 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:39.657454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ec1f77b-37d0-4368-be1a-9a2ea4c23522 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:39.657906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ec1f77b-37d0-4368-be1a-9a2ea4c23522 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:39.658658 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ec1f77b-37d0-4368-be1a-9a2ea4c23522 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:39.659123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ec1f77b-37d0-4368-be1a-9a2ea4c23522 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:39.784635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0ec1f77b-37d0-4368-be1a-9a2ea4c23522 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:39.792611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0ec1f77b-37d0-4368-be1a-9a2ea4c23522 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.146035 Jul 27 20:14:39.793189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 90/183] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:39 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:40.030112 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5fbe6126-533c-40a1-bdeb-eff7b33c578a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:40.030719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5fbe6126-533c-40a1-bdeb-eff7b33c578a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:40.037949 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5fbe6126-533c-40a1-bdeb-eff7b33c578a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:40.038768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5fbe6126-533c-40a1-bdeb-eff7b33c578a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:40.039311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5fbe6126-533c-40a1-bdeb-eff7b33c578a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:40.039899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5fbe6126-533c-40a1-bdeb-eff7b33c578a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:40.182509 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5fbe6126-533c-40a1-bdeb-eff7b33c578a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:40.184838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:40.190936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5fbe6126-533c-40a1-bdeb-eff7b33c578a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.164708 Jul 27 20:14:40.204434 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 94/184] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:40 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:40.813314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cb90a1d1-0b2e-4c6d-b7d3-e7e924e66519 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:40.814028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cb90a1d1-0b2e-4c6d-b7d3-e7e924e66519 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:40.820717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb90a1d1-0b2e-4c6d-b7d3-e7e924e66519 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:40.821466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb90a1d1-0b2e-4c6d-b7d3-e7e924e66519 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:40.822016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb90a1d1-0b2e-4c6d-b7d3-e7e924e66519 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:40.822442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb90a1d1-0b2e-4c6d-b7d3-e7e924e66519 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:40.950149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cb90a1d1-0b2e-4c6d-b7d3-e7e924e66519 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:40.953970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:40.960079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cb90a1d1-0b2e-4c6d-b7d3-e7e924e66519 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.149120 Jul 27 20:14:40.960079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 91/185] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:40 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:41.212953 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bb204dba-0429-4d34-a928-c268fbbff349 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:41.213488 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bb204dba-0429-4d34-a928-c268fbbff349 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:41.219685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb204dba-0429-4d34-a928-c268fbbff349 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:41.219958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb204dba-0429-4d34-a928-c268fbbff349 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:41.220733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb204dba-0429-4d34-a928-c268fbbff349 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:41.221161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb204dba-0429-4d34-a928-c268fbbff349 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:41.371383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bb204dba-0429-4d34-a928-c268fbbff349 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:41.379096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bb204dba-0429-4d34-a928-c268fbbff349 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.170822 Jul 27 20:14:41.379840 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 95/186] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:41 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:41.980472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-888e92ea-618d-4e85-bdac-05d5d78c61a1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:41.981174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-888e92ea-618d-4e85-bdac-05d5d78c61a1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:41.988239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-888e92ea-618d-4e85-bdac-05d5d78c61a1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:41.988723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-888e92ea-618d-4e85-bdac-05d5d78c61a1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:41.989606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-888e92ea-618d-4e85-bdac-05d5d78c61a1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:41.990108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-888e92ea-618d-4e85-bdac-05d5d78c61a1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:42.121064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-888e92ea-618d-4e85-bdac-05d5d78c61a1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:42.128857 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-888e92ea-618d-4e85-bdac-05d5d78c61a1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.152518 Jul 27 20:14:42.133713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 92/187] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:41 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:42.401031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-77545033-e788-48f5-bfcc-a07b78993781 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:42.401644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-77545033-e788-48f5-bfcc-a07b78993781 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:42.407510 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77545033-e788-48f5-bfcc-a07b78993781 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:42.407940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77545033-e788-48f5-bfcc-a07b78993781 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:42.408726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77545033-e788-48f5-bfcc-a07b78993781 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:42.409159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77545033-e788-48f5-bfcc-a07b78993781 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:42.548459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-77545033-e788-48f5-bfcc-a07b78993781 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:42.555950 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-77545033-e788-48f5-bfcc-a07b78993781 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.159416 Jul 27 20:14:42.556553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 96/188] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:42 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:43.149221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6d8a6be0-cd9f-468f-896e-ac9dfed68902 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:43.149752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6d8a6be0-cd9f-468f-896e-ac9dfed68902 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:43.156120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6d8a6be0-cd9f-468f-896e-ac9dfed68902 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:43.156609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6d8a6be0-cd9f-468f-896e-ac9dfed68902 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:43.157357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6d8a6be0-cd9f-468f-896e-ac9dfed68902 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:43.157785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6d8a6be0-cd9f-468f-896e-ac9dfed68902 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:43.392042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6d8a6be0-cd9f-468f-896e-ac9dfed68902 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:43.407101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6d8a6be0-cd9f-468f-896e-ac9dfed68902 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.261719 Jul 27 20:14:43.408217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 93/189] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:43 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:43.577376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8d2065db-3003-44b3-a9a3-b55ca978f7a0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:43.577989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8d2065db-3003-44b3-a9a3-b55ca978f7a0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:43.580913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:43.581555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:43.585292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d2065db-3003-44b3-a9a3-b55ca978f7a0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:43.585745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d2065db-3003-44b3-a9a3-b55ca978f7a0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:43.586507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d2065db-3003-44b3-a9a3-b55ca978f7a0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:43.586946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d2065db-3003-44b3-a9a3-b55ca978f7a0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:43.718271 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8d2065db-3003-44b3-a9a3-b55ca978f7a0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:43.726093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8d2065db-3003-44b3-a9a3-b55ca978f7a0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.152600 Jul 27 20:14:43.726665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 97/190] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:43 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:44.430160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-095ece27-3c9b-4e06-9510-e05bf48d0b55 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:44.430871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-095ece27-3c9b-4e06-9510-e05bf48d0b55 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:44.434151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=4 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:44.437726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-095ece27-3c9b-4e06-9510-e05bf48d0b55 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.438414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-095ece27-3c9b-4e06-9510-e05bf48d0b55 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:44.439176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-095ece27-3c9b-4e06-9510-e05bf48d0b55 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.439602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-095ece27-3c9b-4e06-9510-e05bf48d0b55 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:44.541052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2e480e7c-26d6-43de-af7e-9251631e4f49 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:44.541548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2e480e7c-26d6-43de-af7e-9251631e4f49 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:44.549354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e480e7c-26d6-43de-af7e-9251631e4f49 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.549801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e480e7c-26d6-43de-af7e-9251631e4f49 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:44.550562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e480e7c-26d6-43de-af7e-9251631e4f49 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.550991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e480e7c-26d6-43de-af7e-9251631e4f49 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:44.575917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2e480e7c-26d6-43de-af7e-9251631e4f49 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:14:44.576935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-095ece27-3c9b-4e06-9510-e05bf48d0b55 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:44.585236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-095ece27-3c9b-4e06-9510-e05bf48d0b55 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.160568 Jul 27 20:14:44.585908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 94/191] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:44 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:44.747798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e3f22869-6d45-4eaa-9bd4-76285c42462e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:44.748485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e3f22869-6d45-4eaa-9bd4-76285c42462e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:44.754792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3f22869-6d45-4eaa-9bd4-76285c42462e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.755241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3f22869-6d45-4eaa-9bd4-76285c42462e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:44.756751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3f22869-6d45-4eaa-9bd4-76285c42462e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.757220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3f22869-6d45-4eaa-9bd4-76285c42462e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:44.889609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e3f22869-6d45-4eaa-9bd4-76285c42462e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:44.897036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e3f22869-6d45-4eaa-9bd4-76285c42462e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.153677 Jul 27 20:14:44.897608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 95/192] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:44 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:44.930678 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2e480e7c-26d6-43de-af7e-9251631e4f49 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 204 len: 0 microversion: 2.1 time: 0.393259 Jul 27 20:14:44.931269 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 98/193] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:14:44 2022] DELETE /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 20:14:44.938930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-48e99fd7-f243-4737-94c8-d4265e1beb26 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:44.939625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-48e99fd7-f243-4737-94c8-d4265e1beb26 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:44.946288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48e99fd7-f243-4737-94c8-d4265e1beb26 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.946819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48e99fd7-f243-4737-94c8-d4265e1beb26 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:44.947583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48e99fd7-f243-4737-94c8-d4265e1beb26 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.948015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48e99fd7-f243-4737-94c8-d4265e1beb26 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:45.074766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-48e99fd7-f243-4737-94c8-d4265e1beb26 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:45.082692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-48e99fd7-f243-4737-94c8-d4265e1beb26 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1554 microversion: 2.1 time: 0.147459 Jul 27 20:14:45.083264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 96/194] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:44 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:45.607089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-38c3eb5a-6dce-43b0-8f85-a54e9715b21a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:45.607787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-38c3eb5a-6dce-43b0-8f85-a54e9715b21a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:45.614406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38c3eb5a-6dce-43b0-8f85-a54e9715b21a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:45.614857 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38c3eb5a-6dce-43b0-8f85-a54e9715b21a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:45.615642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38c3eb5a-6dce-43b0-8f85-a54e9715b21a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:45.616074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38c3eb5a-6dce-43b0-8f85-a54e9715b21a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:45.739635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-38c3eb5a-6dce-43b0-8f85-a54e9715b21a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:45.747439 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-38c3eb5a-6dce-43b0-8f85-a54e9715b21a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.144519 Jul 27 20:14:45.748015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 99/195] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:45 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:45.917771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-680b6f8e-3949-4560-b818-d3431b8ebccd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:45.918383 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-680b6f8e-3949-4560-b818-d3431b8ebccd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:45.925261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-680b6f8e-3949-4560-b818-d3431b8ebccd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:45.925711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-680b6f8e-3949-4560-b818-d3431b8ebccd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:45.926733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-680b6f8e-3949-4560-b818-d3431b8ebccd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:45.927166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-680b6f8e-3949-4560-b818-d3431b8ebccd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:46.055833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-680b6f8e-3949-4560-b818-d3431b8ebccd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:46.063214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-680b6f8e-3949-4560-b818-d3431b8ebccd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.149303 Jul 27 20:14:46.063784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 97/196] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:45 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:46.103173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8b6c9829-a0f6-4950-85e0-873cd2d0f1ec tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:46.103787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8b6c9829-a0f6-4950-85e0-873cd2d0f1ec tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:46.109705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b6c9829-a0f6-4950-85e0-873cd2d0f1ec tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:46.110156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b6c9829-a0f6-4950-85e0-873cd2d0f1ec tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:46.110912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b6c9829-a0f6-4950-85e0-873cd2d0f1ec tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:46.111347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b6c9829-a0f6-4950-85e0-873cd2d0f1ec tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:46.240671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8b6c9829-a0f6-4950-85e0-873cd2d0f1ec tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:46.248792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8b6c9829-a0f6-4950-85e0-873cd2d0f1ec tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1554 microversion: 2.1 time: 0.149498 Jul 27 20:14:46.249362 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 100/197] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:46 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:46.768471 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1455de42-87bf-41e4-b4e4-70459bf079b5 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:46.769087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1455de42-87bf-41e4-b4e4-70459bf079b5 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:46.776291 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1455de42-87bf-41e4-b4e4-70459bf079b5 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:46.776778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1455de42-87bf-41e4-b4e4-70459bf079b5 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:46.777531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1455de42-87bf-41e4-b4e4-70459bf079b5 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:46.777964 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1455de42-87bf-41e4-b4e4-70459bf079b5 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:46.906024 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1455de42-87bf-41e4-b4e4-70459bf079b5 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:46.913443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1455de42-87bf-41e4-b4e4-70459bf079b5 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.148825 Jul 27 20:14:46.914024 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 98/198] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:46 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:47.083990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d129a6ea-07e0-4602-88da-24ff4dd6a6b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:47.084630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d129a6ea-07e0-4602-88da-24ff4dd6a6b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:47.090683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d129a6ea-07e0-4602-88da-24ff4dd6a6b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.091132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d129a6ea-07e0-4602-88da-24ff4dd6a6b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.091885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d129a6ea-07e0-4602-88da-24ff4dd6a6b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.092317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d129a6ea-07e0-4602-88da-24ff4dd6a6b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.215281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d129a6ea-07e0-4602-88da-24ff4dd6a6b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:47.222588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d129a6ea-07e0-4602-88da-24ff4dd6a6b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.142398 Jul 27 20:14:47.223153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 101/199] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:47 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:47.270110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4325f13c-c5de-4d53-a191-04b692c7bb7b tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:47.270773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4325f13c-c5de-4d53-a191-04b692c7bb7b tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:47.277449 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4325f13c-c5de-4d53-a191-04b692c7bb7b tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.277892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4325f13c-c5de-4d53-a191-04b692c7bb7b tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.278739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4325f13c-c5de-4d53-a191-04b692c7bb7b tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.279173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4325f13c-c5de-4d53-a191-04b692c7bb7b tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.406660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4325f13c-c5de-4d53-a191-04b692c7bb7b tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:47.415200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4325f13c-c5de-4d53-a191-04b692c7bb7b tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1554 microversion: 2.1 time: 0.149180 Jul 27 20:14:47.415789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 99/200] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:47 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:47.933599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ab0c926e-a0df-44f4-ae83-be947f9672ba tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:47.934232 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ab0c926e-a0df-44f4-ae83-be947f9672ba tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:47.940328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ab0c926e-a0df-44f4-ae83-be947f9672ba tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.940837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ab0c926e-a0df-44f4-ae83-be947f9672ba tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.941596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ab0c926e-a0df-44f4-ae83-be947f9672ba tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.942027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ab0c926e-a0df-44f4-ae83-be947f9672ba tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:48.102017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ab0c926e-a0df-44f4-ae83-be947f9672ba tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:48.112821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ab0c926e-a0df-44f4-ae83-be947f9672ba tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.180669 Jul 27 20:14:48.113430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 102/201] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:47 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:48.243177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-48ec1753-886e-4cc4-b37a-5cfccba741db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:48.244820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-48ec1753-886e-4cc4-b37a-5cfccba741db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:48.251076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48ec1753-886e-4cc4-b37a-5cfccba741db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:48.251517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48ec1753-886e-4cc4-b37a-5cfccba741db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:48.252268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48ec1753-886e-4cc4-b37a-5cfccba741db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:48.262719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48ec1753-886e-4cc4-b37a-5cfccba741db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:48.386159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-48ec1753-886e-4cc4-b37a-5cfccba741db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:48.393754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-48ec1753-886e-4cc4-b37a-5cfccba741db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.154447 Jul 27 20:14:48.394338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 100/202] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:48 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:48.437205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0dfe950a-a366-4d52-8136-622f2101faca tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:48.437808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0dfe950a-a366-4d52-8136-622f2101faca tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:48.443739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0dfe950a-a366-4d52-8136-622f2101faca tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:48.444212 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0dfe950a-a366-4d52-8136-622f2101faca tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:48.445600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0dfe950a-a366-4d52-8136-622f2101faca tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:48.446062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0dfe950a-a366-4d52-8136-622f2101faca tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:48.600831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0dfe950a-a366-4d52-8136-622f2101faca tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:48.608946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0dfe950a-a366-4d52-8136-622f2101faca tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1554 microversion: 2.1 time: 0.175742 Jul 27 20:14:48.609505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 103/203] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:48 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:49.134431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9a728109-c90a-4755-8575-8c5bd6b00251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:49.135029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9a728109-c90a-4755-8575-8c5bd6b00251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:49.141025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a728109-c90a-4755-8575-8c5bd6b00251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.141464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a728109-c90a-4755-8575-8c5bd6b00251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:49.142214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a728109-c90a-4755-8575-8c5bd6b00251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.142973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a728109-c90a-4755-8575-8c5bd6b00251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:49.350048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9a728109-c90a-4755-8575-8c5bd6b00251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:49.366824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9a728109-c90a-4755-8575-8c5bd6b00251 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.236248 Jul 27 20:14:49.369398 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 101/204] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:49 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:49.414495 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-54c311d4-08bc-4ff7-9c48-2bf13a20e3f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:49.415224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-54c311d4-08bc-4ff7-9c48-2bf13a20e3f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:49.421764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54c311d4-08bc-4ff7-9c48-2bf13a20e3f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.422292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54c311d4-08bc-4ff7-9c48-2bf13a20e3f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:49.423131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54c311d4-08bc-4ff7-9c48-2bf13a20e3f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.423572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54c311d4-08bc-4ff7-9c48-2bf13a20e3f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:49.572459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-54c311d4-08bc-4ff7-9c48-2bf13a20e3f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:49.591646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-54c311d4-08bc-4ff7-9c48-2bf13a20e3f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.181617 Jul 27 20:14:49.592640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 104/205] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:49 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:49.630320 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bde65e19-94cd-4308-8ecb-cd8609b17dff tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:49.631085 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bde65e19-94cd-4308-8ecb-cd8609b17dff tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:49.641751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bde65e19-94cd-4308-8ecb-cd8609b17dff tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.641751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bde65e19-94cd-4308-8ecb-cd8609b17dff tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:49.641751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bde65e19-94cd-4308-8ecb-cd8609b17dff tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.641751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bde65e19-94cd-4308-8ecb-cd8609b17dff tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:49.786370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bde65e19-94cd-4308-8ecb-cd8609b17dff tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:49.794563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bde65e19-94cd-4308-8ecb-cd8609b17dff tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1554 microversion: 2.1 time: 0.168005 Jul 27 20:14:49.795145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 102/206] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:49 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:50.389911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-63e1c922-8335-4243-9b95-a6961cffa5b8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:50.390881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-63e1c922-8335-4243-9b95-a6961cffa5b8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:50.398213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63e1c922-8335-4243-9b95-a6961cffa5b8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:50.398987 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63e1c922-8335-4243-9b95-a6961cffa5b8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:50.399753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63e1c922-8335-4243-9b95-a6961cffa5b8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:50.400336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63e1c922-8335-4243-9b95-a6961cffa5b8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:50.590956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-63e1c922-8335-4243-9b95-a6961cffa5b8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:50.600886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-63e1c922-8335-4243-9b95-a6961cffa5b8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.215109 Jul 27 20:14:50.601550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 105/207] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:50 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:50.618274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0f9007be-6cf4-473a-bed6-881fe19d6ae8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:50.619169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0f9007be-6cf4-473a-bed6-881fe19d6ae8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:50.625774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0f9007be-6cf4-473a-bed6-881fe19d6ae8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:50.626217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0f9007be-6cf4-473a-bed6-881fe19d6ae8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:50.626978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0f9007be-6cf4-473a-bed6-881fe19d6ae8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:50.627400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0f9007be-6cf4-473a-bed6-881fe19d6ae8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:50.791065 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0f9007be-6cf4-473a-bed6-881fe19d6ae8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:50.799030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0f9007be-6cf4-473a-bed6-881fe19d6ae8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.185353 Jul 27 20:14:50.800372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 103/208] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:50 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:50.816064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f8533b0f-f4a1-453d-bdf0-6296c01ff1ee tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:50.816892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f8533b0f-f4a1-453d-bdf0-6296c01ff1ee tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:50.828899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8533b0f-f4a1-453d-bdf0-6296c01ff1ee tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:50.828899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8533b0f-f4a1-453d-bdf0-6296c01ff1ee tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:50.828899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8533b0f-f4a1-453d-bdf0-6296c01ff1ee tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:50.828899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8533b0f-f4a1-453d-bdf0-6296c01ff1ee tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:50.957743 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f8533b0f-f4a1-453d-bdf0-6296c01ff1ee tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:50.966467 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f8533b0f-f4a1-453d-bdf0-6296c01ff1ee tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1554 microversion: 2.1 time: 0.154214 Jul 27 20:14:50.967755 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 106/209] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:50 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:51.623147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1feb3f16-8ed6-4cd8-ab60-0fd5317f611a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:51.623751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1feb3f16-8ed6-4cd8-ab60-0fd5317f611a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:51.630604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1feb3f16-8ed6-4cd8-ab60-0fd5317f611a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:51.631038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1feb3f16-8ed6-4cd8-ab60-0fd5317f611a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:51.631865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1feb3f16-8ed6-4cd8-ab60-0fd5317f611a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:51.632494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1feb3f16-8ed6-4cd8-ab60-0fd5317f611a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:51.775506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1feb3f16-8ed6-4cd8-ab60-0fd5317f611a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:51.784045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1feb3f16-8ed6-4cd8-ab60-0fd5317f611a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.165014 Jul 27 20:14:51.785113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 104/210] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:51 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:51.821372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-44be81a4-484f-470c-bd51-9b385e8bfdea tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:51.822579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-44be81a4-484f-470c-bd51-9b385e8bfdea tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:51.828687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44be81a4-484f-470c-bd51-9b385e8bfdea tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:51.829308 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44be81a4-484f-470c-bd51-9b385e8bfdea tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:51.830229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44be81a4-484f-470c-bd51-9b385e8bfdea tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:51.831048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44be81a4-484f-470c-bd51-9b385e8bfdea tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:51.992090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-260f95fc-6ac4-4e52-a81a-64b332e8c34a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:51.992745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-260f95fc-6ac4-4e52-a81a-64b332e8c34a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:52.001932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-260f95fc-6ac4-4e52-a81a-64b332e8c34a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:52.002221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-260f95fc-6ac4-4e52-a81a-64b332e8c34a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:52.002998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-260f95fc-6ac4-4e52-a81a-64b332e8c34a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:52.003420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-260f95fc-6ac4-4e52-a81a-64b332e8c34a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:52.016552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-44be81a4-484f-470c-bd51-9b385e8bfdea tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:52.026998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-44be81a4-484f-470c-bd51-9b385e8bfdea tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.210228 Jul 27 20:14:52.043830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 107/211] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:51 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:52.147901 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-260f95fc-6ac4-4e52-a81a-64b332e8c34a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:52.156265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-260f95fc-6ac4-4e52-a81a-64b332e8c34a tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1554 microversion: 2.1 time: 0.171825 Jul 27 20:14:52.167942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 105/212] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:51 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:52.805327 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e4355df2-1c35-443c-bc84-9fbd97f0ca80 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:52.805936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e4355df2-1c35-443c-bc84-9fbd97f0ca80 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:52.811823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4355df2-1c35-443c-bc84-9fbd97f0ca80 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:52.812267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4355df2-1c35-443c-bc84-9fbd97f0ca80 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:52.813255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4355df2-1c35-443c-bc84-9fbd97f0ca80 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:52.813845 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4355df2-1c35-443c-bc84-9fbd97f0ca80 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:52.962939 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e4355df2-1c35-443c-bc84-9fbd97f0ca80 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:52.970500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e4355df2-1c35-443c-bc84-9fbd97f0ca80 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.169411 Jul 27 20:14:52.971082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 108/213] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:52 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:53.050567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4dd077d5-3178-4a8e-ad9d-e4d5a7cdf2f0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:53.051176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4dd077d5-3178-4a8e-ad9d-e4d5a7cdf2f0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:53.057541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dd077d5-3178-4a8e-ad9d-e4d5a7cdf2f0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:53.057990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dd077d5-3178-4a8e-ad9d-e4d5a7cdf2f0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:53.058744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dd077d5-3178-4a8e-ad9d-e4d5a7cdf2f0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:53.061091 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dd077d5-3178-4a8e-ad9d-e4d5a7cdf2f0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:53.178246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0012e2a3-73d9-4ff9-924e-89e2eabccc43 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:53.179474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0012e2a3-73d9-4ff9-924e-89e2eabccc43 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:53.185634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0012e2a3-73d9-4ff9-924e-89e2eabccc43 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:53.186070 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0012e2a3-73d9-4ff9-924e-89e2eabccc43 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:53.186818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0012e2a3-73d9-4ff9-924e-89e2eabccc43 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:53.187244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0012e2a3-73d9-4ff9-924e-89e2eabccc43 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:53.205998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4dd077d5-3178-4a8e-ad9d-e4d5a7cdf2f0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:53.215458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4dd077d5-3178-4a8e-ad9d-e4d5a7cdf2f0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.168725 Jul 27 20:14:53.216043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 106/214] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:53 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:53.354944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0012e2a3-73d9-4ff9-924e-89e2eabccc43 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:53.357378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:53.363809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0012e2a3-73d9-4ff9-924e-89e2eabccc43 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1554 microversion: 2.1 time: 0.189457 Jul 27 20:14:53.364528 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 109/215] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:53 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:53.992088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-18eae612-a7fb-42b4-8303-39ef03ccc0fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:53.993062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-18eae612-a7fb-42b4-8303-39ef03ccc0fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:54.000189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18eae612-a7fb-42b4-8303-39ef03ccc0fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.000768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18eae612-a7fb-42b4-8303-39ef03ccc0fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.001835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18eae612-a7fb-42b4-8303-39ef03ccc0fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.002319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18eae612-a7fb-42b4-8303-39ef03ccc0fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.189661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-18eae612-a7fb-42b4-8303-39ef03ccc0fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:54.198578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-18eae612-a7fb-42b4-8303-39ef03ccc0fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.210268 Jul 27 20:14:54.199388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 107/216] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:53 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:54.237292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-068f1066-0f1a-4996-9e74-a0832177be80 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:54.237992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-068f1066-0f1a-4996-9e74-a0832177be80 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:54.247369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-068f1066-0f1a-4996-9e74-a0832177be80 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.247870 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-068f1066-0f1a-4996-9e74-a0832177be80 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.248661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-068f1066-0f1a-4996-9e74-a0832177be80 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.249097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-068f1066-0f1a-4996-9e74-a0832177be80 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.387662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e33cd311-5228-4833-b27a-9b2ed8613c2c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:54.388507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e33cd311-5228-4833-b27a-9b2ed8613c2c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:54.399199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e33cd311-5228-4833-b27a-9b2ed8613c2c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.401795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e33cd311-5228-4833-b27a-9b2ed8613c2c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.404642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e33cd311-5228-4833-b27a-9b2ed8613c2c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.408566 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e33cd311-5228-4833-b27a-9b2ed8613c2c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.439036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:54.549597 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e33cd311-5228-4833-b27a-9b2ed8613c2c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:54.563477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e33cd311-5228-4833-b27a-9b2ed8613c2c tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1512 microversion: 2.1 time: 0.179190 Jul 27 20:14:54.565400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 108/217] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:54 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:54.577840 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-068f1066-0f1a-4996-9e74-a0832177be80 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:54.588503 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-10dbc44a-a688-42f9-974c-01dc65248102 req-e458e12f-4b55-46f9-adf0-8115cfb77776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a5a8d3-3084-4481-bb85-14bc9e7f7122", "name": "network-vif-deleted", "tag": "3b591409-24a6-4a88-a41e-f0ae3af44889"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:54.594579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-068f1066-0f1a-4996-9e74-a0832177be80 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.358955 Jul 27 20:14:54.596654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 110/218] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:54 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:54.600801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-10dbc44a-a688-42f9-974c-01dc65248102 req-e458e12f-4b55-46f9-adf0-8115cfb77776 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.601588 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-10dbc44a-a688-42f9-974c-01dc65248102 req-e458e12f-4b55-46f9-adf0-8115cfb77776 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.617988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-10dbc44a-a688-42f9-974c-01dc65248102 req-e458e12f-4b55-46f9-adf0-8115cfb77776 service nova] Creating event network-vif-deleted:3b591409-24a6-4a88-a41e-f0ae3af44889 for instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 on hv-cinder-85124 Jul 27 20:14:54.623940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-10dbc44a-a688-42f9-974c-01dc65248102 req-e458e12f-4b55-46f9-adf0-8115cfb77776 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045789 Jul 27 20:14:54.624599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 109/219] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:14:55.222981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4432afb5-57ac-4352-b601-f7a56894cea0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:55.223625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4432afb5-57ac-4352-b601-f7a56894cea0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:55.229902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4432afb5-57ac-4352-b601-f7a56894cea0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:55.230593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4432afb5-57ac-4352-b601-f7a56894cea0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:55.231385 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4432afb5-57ac-4352-b601-f7a56894cea0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:55.231984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4432afb5-57ac-4352-b601-f7a56894cea0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:55.370288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4432afb5-57ac-4352-b601-f7a56894cea0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:55.377661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4432afb5-57ac-4352-b601-f7a56894cea0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.161352 Jul 27 20:14:55.378255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 111/220] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:55 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:55.591827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a284732b-0fde-432a-9fac-6eea0d50c10d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:55.592459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a284732b-0fde-432a-9fac-6eea0d50c10d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:55.598481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a284732b-0fde-432a-9fac-6eea0d50c10d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:55.598917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a284732b-0fde-432a-9fac-6eea0d50c10d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:55.599656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a284732b-0fde-432a-9fac-6eea0d50c10d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:55.600078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a284732b-0fde-432a-9fac-6eea0d50c10d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:55.621791 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2bfdd785-0eca-44ca-b3af-dbd27adff4cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:55.622520 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2bfdd785-0eca-44ca-b3af-dbd27adff4cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:55.628539 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bfdd785-0eca-44ca-b3af-dbd27adff4cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:55.628981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bfdd785-0eca-44ca-b3af-dbd27adff4cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:55.629734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bfdd785-0eca-44ca-b3af-dbd27adff4cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:55.630164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bfdd785-0eca-44ca-b3af-dbd27adff4cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:55.667279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a284732b-0fde-432a-9fac-6eea0d50c10d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:55.675467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a284732b-0fde-432a-9fac-6eea0d50c10d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1512 microversion: 2.1 time: 0.088684 Jul 27 20:14:55.686008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 110/221] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:55 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1512 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:55.762916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2bfdd785-0eca-44ca-b3af-dbd27adff4cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:55.780071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2bfdd785-0eca-44ca-b3af-dbd27adff4cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.155383 Jul 27 20:14:55.780071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 112/222] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:55 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:56.398795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-25a2280a-ca25-4524-a81a-621677023666 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:56.399407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-25a2280a-ca25-4524-a81a-621677023666 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:56.405513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25a2280a-ca25-4524-a81a-621677023666 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:56.405962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25a2280a-ca25-4524-a81a-621677023666 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:56.406721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25a2280a-ca25-4524-a81a-621677023666 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:56.407150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25a2280a-ca25-4524-a81a-621677023666 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:56.668958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-25a2280a-ca25-4524-a81a-621677023666 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:56.677341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-25a2280a-ca25-4524-a81a-621677023666 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.283162 Jul 27 20:14:56.678194 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 111/223] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:56 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:56.698150 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b85e9e0b-6a7e-4cf5-b870-1fb61be0f8b9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:56.698833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b85e9e0b-6a7e-4cf5-b870-1fb61be0f8b9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:56.704882 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b85e9e0b-6a7e-4cf5-b870-1fb61be0f8b9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:56.705536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b85e9e0b-6a7e-4cf5-b870-1fb61be0f8b9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:56.706359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b85e9e0b-6a7e-4cf5-b870-1fb61be0f8b9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:56.707078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b85e9e0b-6a7e-4cf5-b870-1fb61be0f8b9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:56.759778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-25ec6f2c-732d-476c-bc95-93ef4a982c8d req-facbd40f-aaeb-4f28-a68d-f5f14c801099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb47bd6-9456-46c6-b16a-552336fc32c4", "name": "network-vif-plugged", "status": "completed", "tag": "1f6b19f5-9290-4aaf-aa9c-8d8f8744dd6a"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:56.787070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-25ec6f2c-732d-476c-bc95-93ef4a982c8d req-facbd40f-aaeb-4f28-a68d-f5f14c801099 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:56.787070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-25ec6f2c-732d-476c-bc95-93ef4a982c8d req-facbd40f-aaeb-4f28-a68d-f5f14c801099 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:56.791121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-25ec6f2c-732d-476c-bc95-93ef4a982c8d req-facbd40f-aaeb-4f28-a68d-f5f14c801099 service nova] Creating event network-vif-plugged:1f6b19f5-9290-4aaf-aa9c-8d8f8744dd6a for instance 0eb47bd6-9456-46c6-b16a-552336fc32c4 on hv-cinder-85124 Jul 27 20:14:56.796210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-25ec6f2c-732d-476c-bc95-93ef4a982c8d req-facbd40f-aaeb-4f28-a68d-f5f14c801099 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042909 Jul 27 20:14:56.796445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b85e9e0b-6a7e-4cf5-b870-1fb61be0f8b9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:56.797362 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 112/224] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:14:56.806423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bf463edd-401a-4ccd-a158-1700aa09b135 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:56.806566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b85e9e0b-6a7e-4cf5-b870-1fb61be0f8b9 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1346 microversion: 2.1 time: 0.112630 Jul 27 20:14:56.807432 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 113/225] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:56 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:56.807641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bf463edd-401a-4ccd-a158-1700aa09b135 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:56.815160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bf463edd-401a-4ccd-a158-1700aa09b135 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:56.815160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bf463edd-401a-4ccd-a158-1700aa09b135 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:56.815364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bf463edd-401a-4ccd-a158-1700aa09b135 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:56.815775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bf463edd-401a-4ccd-a158-1700aa09b135 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:56.951384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bf463edd-401a-4ccd-a158-1700aa09b135 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:56.959046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bf463edd-401a-4ccd-a158-1700aa09b135 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.160401 Jul 27 20:14:56.962873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 113/226] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:56 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:57.701375 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ac1f6a65-65b3-4b1a-a121-a422930c1fbc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:57.708538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ac1f6a65-65b3-4b1a-a121-a422930c1fbc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:57.710065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:57.714737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac1f6a65-65b3-4b1a-a121-a422930c1fbc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.715189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac1f6a65-65b3-4b1a-a121-a422930c1fbc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:57.715973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac1f6a65-65b3-4b1a-a121-a422930c1fbc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.716457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac1f6a65-65b3-4b1a-a121-a422930c1fbc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:57.828690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d348fed9-c76d-4785-bf77-d0afdd122d68 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:57.829937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d348fed9-c76d-4785-bf77-d0afdd122d68 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:57.838629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d348fed9-c76d-4785-bf77-d0afdd122d68 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.839153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d348fed9-c76d-4785-bf77-d0afdd122d68 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:57.840075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d348fed9-c76d-4785-bf77-d0afdd122d68 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.840703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d348fed9-c76d-4785-bf77-d0afdd122d68 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:57.886071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ac1f6a65-65b3-4b1a-a121-a422930c1fbc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:57.896285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ac1f6a65-65b3-4b1a-a121-a422930c1fbc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.198660 Jul 27 20:14:57.900435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 114/227] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:57 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:57.931696 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d348fed9-c76d-4785-bf77-d0afdd122d68 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:57.940851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d348fed9-c76d-4785-bf77-d0afdd122d68 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1346 microversion: 2.1 time: 0.116550 Jul 27 20:14:57.941828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 114/228] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:57 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:57.979348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9a918cc5-2b74-4aa8-be67-b768c2169478 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:57.979962 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9a918cc5-2b74-4aa8-be67-b768c2169478 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:57.986912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a918cc5-2b74-4aa8-be67-b768c2169478 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.990728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a918cc5-2b74-4aa8-be67-b768c2169478 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:57.990728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a918cc5-2b74-4aa8-be67-b768c2169478 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.990728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a918cc5-2b74-4aa8-be67-b768c2169478 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:58.123958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9a918cc5-2b74-4aa8-be67-b768c2169478 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:58.131269 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9a918cc5-2b74-4aa8-be67-b768c2169478 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.155790 Jul 27 20:14:58.131835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 115/229] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:57 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:58.920514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a16d7c2d-b24f-4792-9aec-c9d452eafa60 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:58.921127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a16d7c2d-b24f-4792-9aec-c9d452eafa60 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:58.927631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a16d7c2d-b24f-4792-9aec-c9d452eafa60 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:58.928097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a16d7c2d-b24f-4792-9aec-c9d452eafa60 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:58.928852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a16d7c2d-b24f-4792-9aec-c9d452eafa60 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:58.929280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a16d7c2d-b24f-4792-9aec-c9d452eafa60 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:58.962917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-02fa90ec-d253-4016-a739-6f73f7686e6f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:58.963517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-02fa90ec-d253-4016-a739-6f73f7686e6f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:58.969933 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02fa90ec-d253-4016-a739-6f73f7686e6f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:58.970372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02fa90ec-d253-4016-a739-6f73f7686e6f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:58.973730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02fa90ec-d253-4016-a739-6f73f7686e6f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:58.973730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02fa90ec-d253-4016-a739-6f73f7686e6f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.056035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-02fa90ec-d253-4016-a739-6f73f7686e6f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:59.058886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-02fa90ec-d253-4016-a739-6f73f7686e6f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1346 microversion: 2.1 time: 0.100286 Jul 27 20:14:59.059874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 116/230] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:58 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:59.089815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a16d7c2d-b24f-4792-9aec-c9d452eafa60 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:59.095740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a16d7c2d-b24f-4792-9aec-c9d452eafa60 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.179163 Jul 27 20:14:59.096321 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 115/231] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:58 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:59.152961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6d21f795-bb09-44dd-8353-26621b7a973d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:59.153569 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6d21f795-bb09-44dd-8353-26621b7a973d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:59.159478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d21f795-bb09-44dd-8353-26621b7a973d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.159955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d21f795-bb09-44dd-8353-26621b7a973d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.160733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d21f795-bb09-44dd-8353-26621b7a973d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.161164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d21f795-bb09-44dd-8353-26621b7a973d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.288016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6d21f795-bb09-44dd-8353-26621b7a973d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:59.295491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6d21f795-bb09-44dd-8353-26621b7a973d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.146413 Jul 27 20:14:59.296058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 117/232] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:59 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:00.079079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-729378ea-29f5-443d-8d5e-5988ca7139ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:00.079682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-729378ea-29f5-443d-8d5e-5988ca7139ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:00.082405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=74 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:00.087732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-729378ea-29f5-443d-8d5e-5988ca7139ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:00.088167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-729378ea-29f5-443d-8d5e-5988ca7139ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:00.088960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-729378ea-29f5-443d-8d5e-5988ca7139ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:00.089387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-729378ea-29f5-443d-8d5e-5988ca7139ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:00.117823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-09056d5d-f638-480f-a5ac-7b1f0197492e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:00.118956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-09056d5d-f638-480f-a5ac-7b1f0197492e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:00.130436 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09056d5d-f638-480f-a5ac-7b1f0197492e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:00.130870 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09056d5d-f638-480f-a5ac-7b1f0197492e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:00.131628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09056d5d-f638-480f-a5ac-7b1f0197492e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:00.132556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09056d5d-f638-480f-a5ac-7b1f0197492e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:00.160496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-729378ea-29f5-443d-8d5e-5988ca7139ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:00.168721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-729378ea-29f5-443d-8d5e-5988ca7139ea tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1346 microversion: 2.1 time: 0.093434 Jul 27 20:15:00.169280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 116/233] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:00 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:00.264609 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-09056d5d-f638-480f-a5ac-7b1f0197492e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:00.271916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-09056d5d-f638-480f-a5ac-7b1f0197492e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.158758 Jul 27 20:15:00.272537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 118/234] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:00 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:00.317354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f1c63c3d-068b-4aff-8590-a4834f859e69 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:00.317967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f1c63c3d-068b-4aff-8590-a4834f859e69 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:00.324508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1c63c3d-068b-4aff-8590-a4834f859e69 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:00.324992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1c63c3d-068b-4aff-8590-a4834f859e69 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:00.325850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1c63c3d-068b-4aff-8590-a4834f859e69 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:00.326286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1c63c3d-068b-4aff-8590-a4834f859e69 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:00.493088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f1c63c3d-068b-4aff-8590-a4834f859e69 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:00.501146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f1c63c3d-068b-4aff-8590-a4834f859e69 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.188225 Jul 27 20:15:00.501815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 117/235] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:00 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:01.192120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:01.192120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:01.198108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.198108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.199581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.200814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.241833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.242395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.242925 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lazy-loading 'fault' on Instance uuid d8a5a8d3-3084-4481-bb85-14bc9e7f7122 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:15:01.292305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:01.295110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0c998828-ff01-4267-b84d-ff40ba2743cb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:01.296328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0c998828-ff01-4267-b84d-ff40ba2743cb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:01.301080 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-433c7ec4-2177-4742-9013-5101f4e79b78 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1351 microversion: 2.1 time: 0.116611 Jul 27 20:15:01.301664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 119/236] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:01 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:01.303243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c998828-ff01-4267-b84d-ff40ba2743cb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.303691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c998828-ff01-4267-b84d-ff40ba2743cb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.304797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c998828-ff01-4267-b84d-ff40ba2743cb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.305257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c998828-ff01-4267-b84d-ff40ba2743cb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.452247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0c998828-ff01-4267-b84d-ff40ba2743cb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:01.459891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0c998828-ff01-4267-b84d-ff40ba2743cb tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1522 microversion: 2.1 time: 0.169004 Jul 27 20:15:01.461427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 118/237] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:01 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:01.524765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3c9725c7-6004-42dc-9884-58ab97516f97 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:01.525554 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3c9725c7-6004-42dc-9884-58ab97516f97 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:01.536745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c9725c7-6004-42dc-9884-58ab97516f97 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.537253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c9725c7-6004-42dc-9884-58ab97516f97 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.538217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c9725c7-6004-42dc-9884-58ab97516f97 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.538733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c9725c7-6004-42dc-9884-58ab97516f97 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.674300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3c9725c7-6004-42dc-9884-58ab97516f97 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:01.685633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3c9725c7-6004-42dc-9884-58ab97516f97 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.166202 Jul 27 20:15:01.688202 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 120/238] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:01 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:02.321940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:02.322542 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:02.328891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.329409 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.330152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.330574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.361539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.362009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.362448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lazy-loading 'fault' on Instance uuid d8a5a8d3-3084-4481-bb85-14bc9e7f7122 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:15:02.406799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:02.414602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-deebd613-0910-4e39-94a5-7d3a8c9620bb tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1351 microversion: 2.1 time: 0.096920 Jul 27 20:15:02.415162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 119/239] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:02 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:02.481252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ee25203d-870c-4e06-a449-98fab252dc7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:02.481813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ee25203d-870c-4e06-a449-98fab252dc7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:02.487752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee25203d-870c-4e06-a449-98fab252dc7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.488195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee25203d-870c-4e06-a449-98fab252dc7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.488992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee25203d-870c-4e06-a449-98fab252dc7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.489422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee25203d-870c-4e06-a449-98fab252dc7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.620842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ee25203d-870c-4e06-a449-98fab252dc7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:02.628717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ee25203d-870c-4e06-a449-98fab252dc7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1502 microversion: 2.1 time: 0.151357 Jul 27 20:15:02.633971 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 121/240] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:02 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:02.654141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f84c8a18-ba59-40fd-a234-3d25763a99a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:02.656207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f84c8a18-ba59-40fd-a234-3d25763a99a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:02.660539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f84c8a18-ba59-40fd-a234-3d25763a99a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.660987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f84c8a18-ba59-40fd-a234-3d25763a99a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.661765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f84c8a18-ba59-40fd-a234-3d25763a99a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.662189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f84c8a18-ba59-40fd-a234-3d25763a99a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.706922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d6eb0dd4-4419-4f2c-ad7b-4421137fcca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:02.707532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d6eb0dd4-4419-4f2c-ad7b-4421137fcca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:02.714491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6eb0dd4-4419-4f2c-ad7b-4421137fcca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.714941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6eb0dd4-4419-4f2c-ad7b-4421137fcca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.715922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6eb0dd4-4419-4f2c-ad7b-4421137fcca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.716542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6eb0dd4-4419-4f2c-ad7b-4421137fcca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.832272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f84c8a18-ba59-40fd-a234-3d25763a99a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:02.840525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f84c8a18-ba59-40fd-a234-3d25763a99a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1515 microversion: 2.1 time: 0.190667 Jul 27 20:15:02.841102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 120/241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:02 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:02.885091 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d6eb0dd4-4419-4f2c-ad7b-4421137fcca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:02.892687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d6eb0dd4-4419-4f2c-ad7b-4421137fcca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.189633 Jul 27 20:15:02.893261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 122/242] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:02 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:03.435186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:03.435805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:03.442199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:03.442847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:03.443769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:03.444372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:03.479975 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:03.480484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:03.481019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lazy-loading 'fault' on Instance uuid d8a5a8d3-3084-4481-bb85-14bc9e7f7122 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:15:03.523846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:03.532167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f4c907a3-60a8-4ca6-8dd7-94bc8463dca1 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1351 microversion: 2.1 time: 0.100731 Jul 27 20:15:03.532842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 121/243] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:03 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:03.914639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4becd063-f31e-4c3e-8167-9022ad6aa1d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:03.915177 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4becd063-f31e-4c3e-8167-9022ad6aa1d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:03.921225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4becd063-f31e-4c3e-8167-9022ad6aa1d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:03.921664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4becd063-f31e-4c3e-8167-9022ad6aa1d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:03.922415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4becd063-f31e-4c3e-8167-9022ad6aa1d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:03.922848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4becd063-f31e-4c3e-8167-9022ad6aa1d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:04.050086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4becd063-f31e-4c3e-8167-9022ad6aa1d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:04.058369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4becd063-f31e-4c3e-8167-9022ad6aa1d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.148166 Jul 27 20:15:04.058944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 123/244] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:03 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:04.553355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:04.554456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:04.561278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:04.561792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:04.562587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:04.563017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:04.593443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:04.593891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:04.594330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lazy-loading 'fault' on Instance uuid d8a5a8d3-3084-4481-bb85-14bc9e7f7122 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:15:04.638920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:04.646990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a7b801a3-5846-481f-8380-cc3d606ef7e3 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1351 microversion: 2.1 time: 0.097346 Jul 27 20:15:04.647568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 122/245] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:04 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:05.078945 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1f933db2-dac6-42d2-b457-f921cb5a5cca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:05.079550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1f933db2-dac6-42d2-b457-f921cb5a5cca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:05.086992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f933db2-dac6-42d2-b457-f921cb5a5cca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:05.091508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f933db2-dac6-42d2-b457-f921cb5a5cca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:05.091508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f933db2-dac6-42d2-b457-f921cb5a5cca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:05.091508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f933db2-dac6-42d2-b457-f921cb5a5cca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:05.218937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1f933db2-dac6-42d2-b457-f921cb5a5cca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:05.226256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1f933db2-dac6-42d2-b457-f921cb5a5cca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1319 microversion: 2.1 time: 0.151116 Jul 27 20:15:05.226821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 124/246] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:05 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:05.668294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:05.669511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:05.676160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:05.676636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:05.677395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:05.677845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:05.711823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:05.712265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:05.712737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lazy-loading 'fault' on Instance uuid d8a5a8d3-3084-4481-bb85-14bc9e7f7122 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:15:05.758120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d2938afd97422795662ec0581d4fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3448cb63d9b741a7956a5fc844820111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:05.766474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-65ff3047-deb2-4da9-a435-db5955ba7066 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 200 len: 1351 microversion: 2.1 time: 0.102183 Jul 27 20:15:05.767055 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 123/247] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:05 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:06.247836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4cd12362-e29a-4ace-aae9-e520fc332242 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:06.248547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4cd12362-e29a-4ace-aae9-e520fc332242 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:06.254615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cd12362-e29a-4ace-aae9-e520fc332242 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.255068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cd12362-e29a-4ace-aae9-e520fc332242 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.255851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cd12362-e29a-4ace-aae9-e520fc332242 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.256281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cd12362-e29a-4ace-aae9-e520fc332242 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.391671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4cd12362-e29a-4ace-aae9-e520fc332242 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:06.399889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4cd12362-e29a-4ace-aae9-e520fc332242 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1508 microversion: 2.1 time: 0.156150 Jul 27 20:15:06.404551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 125/248] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:06 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:06.728808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ea23d91-5711-45d9-9053-bf32f110c1da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:06.728808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ea23d91-5711-45d9-9053-bf32f110c1da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:06.733582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ea23d91-5711-45d9-9053-bf32f110c1da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.734101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ea23d91-5711-45d9-9053-bf32f110c1da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.734896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ea23d91-5711-45d9-9053-bf32f110c1da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.735322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ea23d91-5711-45d9-9053-bf32f110c1da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.789208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:06.790698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:06.799912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.800551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.801598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.802499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.807844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:06.819318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] HTTP exception thrown: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Request method failure captured: Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 HTTP/1.1 Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxpcIYD0X7pd-xoxl9xR3DksUpZoO9NbDg82tIxdXv_DrzNhzZ9yfcBI8V9rvptvCiIcyvk0XQVLQidy3VG2wzcI8ddalsUK6DiIujUyxumNFORgAbRxLoyikIxRZ1vkOJw9yvjb0RDl46xJHsI_zFQ8qeMt6Uv51bcxSKmfTeygOk Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 3448cb63d9b741a7956a5fc844820111 Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:15:06.825253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3448cb63d9b741a7956a5fc844820111", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 3448cb63d9b741a7956a5fc844820111 Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-DeleteServersTestJSON-1461958085-project Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 23d2938afd97422795662ec0581d4fa0 Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-DeleteServersTestJSON-1461958085-project Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:06.836691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': 'd8a5a8d3-3084-4481-bb85-14bc9e7f7122'} Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:15:06.837850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:06.838956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:06.841158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Returning 404 to user: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:15:06.841158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-012288d1-93d0-4fad-af02-b156e5a07c0d tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 404 len: 111 microversion: 2.1 time: 0.045290 Jul 27 20:15:06.841158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 126/249] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:06 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:15:06.899226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-4ea23d91-5711-45d9-9053-bf32f110c1da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lazy-loading 'flavor' on Instance uuid 77d4ea93-fe33-426a-aa16-4ecfa7521db5 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:15:06.914177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:07.053464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:07.056242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:07.064610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:07.068242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:07.068242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:07.068242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:07.084074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] HTTP exception thrown: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Request method failure captured: Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122/os-volume_attachments HTTP/1.1 Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxpcIYD0X7pd-xoxl9xR3DksUpZoO9NbDg82tIxdXv_DrzNhzZ9yfcBI8V9rvptvCiIcyvk0XQVLQidy3VG2wzcI8ddalsUK6DiIujUyxumNFORgAbRxLoyikIxRZ1vkOJw9yvjb0RDl46xJHsI_zFQ8qeMt6Uv51bcxSKmfTeygOk Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 3448cb63d9b741a7956a5fc844820111 Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:15:07.086722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3448cb63d9b741a7956a5fc844820111", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 3448cb63d9b741a7956a5fc844820111 Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-DeleteServersTestJSON-1461958085-project Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 23d2938afd97422795662ec0581d4fa0 Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-DeleteServersTestJSON-1461958085-project Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:07.088062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'server_id': 'd8a5a8d3-3084-4481-bb85-14bc9e7f7122'} Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:15:07.088705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:07.089680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:07.091411 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Returning 404 to user: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:15:07.092555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6e307449-f3ea-4230-9c60-cb64598a770f tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043132 Jul 27 20:15:07.093829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 127/250] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:07 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 20:15:07.217979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ea23d91-5711-45d9-9053-bf32f110c1da tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "POST /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5/action" status: 200 len: 32 microversion: 2.1 time: 0.499465 Jul 27 20:15:07.218609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 124/251] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:15:06 2022] POST /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5/action => generated 32 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 20:15:07.229560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2ac3e915-f495-4cca-849f-ff1b5335cb83 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:07.230174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2ac3e915-f495-4cca-849f-ff1b5335cb83 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:07.236257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ac3e915-f495-4cca-849f-ff1b5335cb83 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:07.236745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ac3e915-f495-4cca-849f-ff1b5335cb83 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:07.237511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ac3e915-f495-4cca-849f-ff1b5335cb83 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:07.237948 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ac3e915-f495-4cca-849f-ff1b5335cb83 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:07.376698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2ac3e915-f495-4cca-849f-ff1b5335cb83 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:07.385955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2ac3e915-f495-4cca-849f-ff1b5335cb83 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.160555 Jul 27 20:15:07.386532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 128/252] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:07 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:08.408273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9d3a15b5-3235-4dcf-9e55-fb83a11b4862 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:08.409308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9d3a15b5-3235-4dcf-9e55-fb83a11b4862 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:08.416767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d3a15b5-3235-4dcf-9e55-fb83a11b4862 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:08.417220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d3a15b5-3235-4dcf-9e55-fb83a11b4862 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:08.418011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d3a15b5-3235-4dcf-9e55-fb83a11b4862 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:08.418450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d3a15b5-3235-4dcf-9e55-fb83a11b4862 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:08.562414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9d3a15b5-3235-4dcf-9e55-fb83a11b4862 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:08.569832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9d3a15b5-3235-4dcf-9e55-fb83a11b4862 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.166374 Jul 27 20:15:08.570390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 125/253] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:08 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:09.590873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ff1a7771-29ed-4767-b9e3-fb324e7d5253 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:09.591584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ff1a7771-29ed-4767-b9e3-fb324e7d5253 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:09.597718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff1a7771-29ed-4767-b9e3-fb324e7d5253 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:09.598106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff1a7771-29ed-4767-b9e3-fb324e7d5253 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:09.598850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff1a7771-29ed-4767-b9e3-fb324e7d5253 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:09.599278 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff1a7771-29ed-4767-b9e3-fb324e7d5253 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:09.722156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ff1a7771-29ed-4767-b9e3-fb324e7d5253 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:09.730035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ff1a7771-29ed-4767-b9e3-fb324e7d5253 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.142966 Jul 27 20:15:09.730601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 129/254] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:09 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:10.750359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5d929e72-1176-4c2d-9686-5c56ad38aa70 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:10.751035 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5d929e72-1176-4c2d-9686-5c56ad38aa70 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:10.758015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d929e72-1176-4c2d-9686-5c56ad38aa70 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:10.758454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d929e72-1176-4c2d-9686-5c56ad38aa70 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:10.759199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d929e72-1176-4c2d-9686-5c56ad38aa70 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:10.759624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d929e72-1176-4c2d-9686-5c56ad38aa70 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:10.891825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5d929e72-1176-4c2d-9686-5c56ad38aa70 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:10.899381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5d929e72-1176-4c2d-9686-5c56ad38aa70 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.152981 Jul 27 20:15:10.899947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 126/255] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:10 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:11.676346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:11.676977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:11.685658 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:11.685910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:11.686701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:11.687143 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:11.701640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] HTTP exception thrown: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Request method failure captured: Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 HTTP/1.1 Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxpcIYD0X7pd-xoxl9xR3DksUpZoO9NbDg82tIxdXv_DrzNhzZ9yfcBI8V9rvptvCiIcyvk0XQVLQidy3VG2wzcI8ddalsUK6DiIujUyxumNFORgAbRxLoyikIxRZ1vkOJw9yvjb0RDl46xJHsI_zFQ8qeMt6Uv51bcxSKmfTeygOk Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 3448cb63d9b741a7956a5fc844820111 Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:15:11.703182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3448cb63d9b741a7956a5fc844820111", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 3448cb63d9b741a7956a5fc844820111 Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-DeleteServersTestJSON-1461958085-project Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 23d2938afd97422795662ec0581d4fa0 Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-DeleteServersTestJSON-1461958085-project Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.704544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': 'd8a5a8d3-3084-4481-bb85-14bc9e7f7122'} Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:15:11.705346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.706555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.707771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Returning 404 to user: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:15:11.707771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3759c1c9-ec0d-4f44-8739-4deab8f71f84 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 404 len: 111 microversion: 2.1 time: 0.032610 Jul 27 20:15:11.707771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 130/256] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:15:11 2022] DELETE /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:15:11.713795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:11.714404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] [instance: d8a5a8d3-3084-4481-bb85-14bc9e7f7122] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:11.720297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:11.720808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:11.721569 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:11.722001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:11.738184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] HTTP exception thrown: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Request method failure captured: Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 HTTP/1.1 Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxpcIYD0X7pd-xoxl9xR3DksUpZoO9NbDg82tIxdXv_DrzNhzZ9yfcBI8V9rvptvCiIcyvk0XQVLQidy3VG2wzcI8ddalsUK6DiIujUyxumNFORgAbRxLoyikIxRZ1vkOJw9yvjb0RDl46xJHsI_zFQ8qeMt6Uv51bcxSKmfTeygOk Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 3448cb63d9b741a7956a5fc844820111 Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:15:11.742691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3448cb63d9b741a7956a5fc844820111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3448cb63d9b741a7956a5fc844820111", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 3448cb63d9b741a7956a5fc844820111 Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-DeleteServersTestJSON-1461958085 Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-DeleteServersTestJSON-1461958085-project Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 23d2938afd97422795662ec0581d4fa0 Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-DeleteServersTestJSON-1461958085-project Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.744518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': 'd8a5a8d3-3084-4481-bb85-14bc9e7f7122'} Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:15:11.745231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. Jul 27 20:15:11.746356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:15:11.747323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] Returning 404 to user: Instance d8a5a8d3-3084-4481-bb85-14bc9e7f7122 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:15:11.747323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-68284149-6497-4be9-aefd-1ef48156f048 tempest-DeleteServersTestJSON-1461958085 tempest-DeleteServersTestJSON-1461958085-project] 10.222.0.47 "GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122" status: 404 len: 111 microversion: 2.1 time: 0.035110 Jul 27 20:15:11.747323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 127/257] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:11 2022] GET /compute/v2.1/servers/d8a5a8d3-3084-4481-bb85-14bc9e7f7122 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:15:11.921096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dccfdd91-3942-4642-b4e1-4a7a0ccd966a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:11.922180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dccfdd91-3942-4642-b4e1-4a7a0ccd966a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:11.928710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dccfdd91-3942-4642-b4e1-4a7a0ccd966a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:11.929196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dccfdd91-3942-4642-b4e1-4a7a0ccd966a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:11.929971 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dccfdd91-3942-4642-b4e1-4a7a0ccd966a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:11.930419 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dccfdd91-3942-4642-b4e1-4a7a0ccd966a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:12.065520 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dccfdd91-3942-4642-b4e1-4a7a0ccd966a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:12.074275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dccfdd91-3942-4642-b4e1-4a7a0ccd966a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.157121 Jul 27 20:15:12.074841 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 131/258] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:11 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:13.097309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e637d936-b309-4055-a004-645e52fbd03a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:13.098022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e637d936-b309-4055-a004-645e52fbd03a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:13.106352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e637d936-b309-4055-a004-645e52fbd03a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:13.107166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e637d936-b309-4055-a004-645e52fbd03a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:13.108581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e637d936-b309-4055-a004-645e52fbd03a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:13.109389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e637d936-b309-4055-a004-645e52fbd03a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:13.281786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e637d936-b309-4055-a004-645e52fbd03a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:13.289882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e637d936-b309-4055-a004-645e52fbd03a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.196987 Jul 27 20:15:13.290636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 128/259] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:13 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:14.311758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d00e04ba-2648-4bd6-b354-de3b6e8eb4ac tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:14.320667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d00e04ba-2648-4bd6-b354-de3b6e8eb4ac tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:14.345318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d00e04ba-2648-4bd6-b354-de3b6e8eb4ac tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:14.346050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d00e04ba-2648-4bd6-b354-de3b6e8eb4ac tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:14.346984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d00e04ba-2648-4bd6-b354-de3b6e8eb4ac tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:14.347414 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d00e04ba-2648-4bd6-b354-de3b6e8eb4ac tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:14.512848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d00e04ba-2648-4bd6-b354-de3b6e8eb4ac tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:14.520910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d00e04ba-2648-4bd6-b354-de3b6e8eb4ac tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.214105 Jul 27 20:15:14.521434 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 132/260] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:14 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:15.551714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-322ef204-af86-40e8-9f69-407a4e7faa3a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:15.553105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-322ef204-af86-40e8-9f69-407a4e7faa3a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:15.561374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-322ef204-af86-40e8-9f69-407a4e7faa3a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:15.562230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-322ef204-af86-40e8-9f69-407a4e7faa3a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:15.565319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-322ef204-af86-40e8-9f69-407a4e7faa3a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:15.565319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-322ef204-af86-40e8-9f69-407a4e7faa3a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:15.740851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-322ef204-af86-40e8-9f69-407a4e7faa3a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:15.749422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-322ef204-af86-40e8-9f69-407a4e7faa3a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.207999 Jul 27 20:15:15.763269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 129/261] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:15 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:16.771525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-009b3e86-07fd-4bd9-8595-2ba72cc909c7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:16.772224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-009b3e86-07fd-4bd9-8595-2ba72cc909c7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:16.779388 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-009b3e86-07fd-4bd9-8595-2ba72cc909c7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:16.779826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-009b3e86-07fd-4bd9-8595-2ba72cc909c7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:16.780622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-009b3e86-07fd-4bd9-8595-2ba72cc909c7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:16.781051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-009b3e86-07fd-4bd9-8595-2ba72cc909c7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:16.939429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-009b3e86-07fd-4bd9-8595-2ba72cc909c7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:16.951412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-009b3e86-07fd-4bd9-8595-2ba72cc909c7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.184580 Jul 27 20:15:16.953463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 133/262] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:16 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:17.976572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3e1138fb-21ec-4347-95d9-eec6fcb47252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:17.976572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3e1138fb-21ec-4347-95d9-eec6fcb47252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:17.983531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e1138fb-21ec-4347-95d9-eec6fcb47252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:17.984013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e1138fb-21ec-4347-95d9-eec6fcb47252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:17.985033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e1138fb-21ec-4347-95d9-eec6fcb47252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:17.985687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e1138fb-21ec-4347-95d9-eec6fcb47252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:18.119475 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3e1138fb-21ec-4347-95d9-eec6fcb47252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:18.128320 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3e1138fb-21ec-4347-95d9-eec6fcb47252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.157615 Jul 27 20:15:18.128937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 130/263] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:17 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:19.149112 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-55b13d70-feef-40e0-83c3-837e3d70cb02 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:19.150304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-55b13d70-feef-40e0-83c3-837e3d70cb02 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:19.156760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-55b13d70-feef-40e0-83c3-837e3d70cb02 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:19.157194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-55b13d70-feef-40e0-83c3-837e3d70cb02 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:19.158054 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-55b13d70-feef-40e0-83c3-837e3d70cb02 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:19.158363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-55b13d70-feef-40e0-83c3-837e3d70cb02 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:19.349609 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-55b13d70-feef-40e0-83c3-837e3d70cb02 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:19.358838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-55b13d70-feef-40e0-83c3-837e3d70cb02 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.213501 Jul 27 20:15:19.361490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 134/264] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:19 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:20.388298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bdaf1921-25c7-414c-9416-5a01a7bc69d7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:20.394740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bdaf1921-25c7-414c-9416-5a01a7bc69d7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:20.402123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bdaf1921-25c7-414c-9416-5a01a7bc69d7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:20.402577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bdaf1921-25c7-414c-9416-5a01a7bc69d7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:20.403549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bdaf1921-25c7-414c-9416-5a01a7bc69d7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:20.404171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bdaf1921-25c7-414c-9416-5a01a7bc69d7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:20.732730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bdaf1921-25c7-414c-9416-5a01a7bc69d7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:20.740921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bdaf1921-25c7-414c-9416-5a01a7bc69d7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.357580 Jul 27 20:15:20.741558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 131/265] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:20 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:21.763298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-acf7c9b6-81c9-45ee-9a26-d2129a5ce17f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:21.763982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-acf7c9b6-81c9-45ee-9a26-d2129a5ce17f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:21.770562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acf7c9b6-81c9-45ee-9a26-d2129a5ce17f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:21.771013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acf7c9b6-81c9-45ee-9a26-d2129a5ce17f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:21.771842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acf7c9b6-81c9-45ee-9a26-d2129a5ce17f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:21.772303 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acf7c9b6-81c9-45ee-9a26-d2129a5ce17f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:21.956730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-acf7c9b6-81c9-45ee-9a26-d2129a5ce17f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:21.964447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-acf7c9b6-81c9-45ee-9a26-d2129a5ce17f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.205939 Jul 27 20:15:21.965905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 135/266] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:21 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:22.986619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d9424e26-e62e-4537-b984-93455fdd5efd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:22.987825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d9424e26-e62e-4537-b984-93455fdd5efd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:22.996099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9424e26-e62e-4537-b984-93455fdd5efd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:22.996802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9424e26-e62e-4537-b984-93455fdd5efd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:22.997805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9424e26-e62e-4537-b984-93455fdd5efd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:22.998460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9424e26-e62e-4537-b984-93455fdd5efd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:23.256651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9424e26-e62e-4537-b984-93455fdd5efd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:23.268966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d9424e26-e62e-4537-b984-93455fdd5efd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.285896 Jul 27 20:15:23.270195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 132/267] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:22 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:24.291061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-328d4a6e-3bc6-4422-ac13-735ba9dac1d0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:24.291735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-328d4a6e-3bc6-4422-ac13-735ba9dac1d0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:24.300056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-328d4a6e-3bc6-4422-ac13-735ba9dac1d0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:24.300534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-328d4a6e-3bc6-4422-ac13-735ba9dac1d0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:24.301497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-328d4a6e-3bc6-4422-ac13-735ba9dac1d0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:24.301942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-328d4a6e-3bc6-4422-ac13-735ba9dac1d0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:24.405912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aae0602a-e33e-454f-9835-ab191345aa8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Action: 'create', calling method: .version_select at 0x7f35cb081ee0>, body: {"keypair": {"name": "tempest-keypair-275638179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzD3oXvXi4vnTHdv9Abg5kIUavUVU8BCQ2X/pP4UV4zwudn1VIaZCIEARa9uQVkAZsNbPGstZEgHl2gvOSE29AGsu5lC6ujytJN3URxMZRD/n8cpsGewoyxHqM4Qwh5iw=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:24.436140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-aae0602a-e33e-454f-9835-ab191345aa8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Getting quotas for project a74675480e734145a1692641342c3e99. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:15:24.442111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-aae0602a-e33e-454f-9835-ab191345aa8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Getting quotas for user caca4eade01642af9322aa72f7443726 and project a74675480e734145a1692641342c3e99. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:15:24.490711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-328d4a6e-3bc6-4422-ac13-735ba9dac1d0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:24.501607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-328d4a6e-3bc6-4422-ac13-735ba9dac1d0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.214879 Jul 27 20:15:24.502204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 133/268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:24 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:24.576237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aae0602a-e33e-454f-9835-ab191345aa8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.341980 Jul 27 20:15:24.576957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 136/269] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Jul 27 20:15:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 343 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 20:15:25.523701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-005e6d61-99bd-4b81-9727-8755ddbb6bfa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:25.525108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-005e6d61-99bd-4b81-9727-8755ddbb6bfa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:25.536723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-005e6d61-99bd-4b81-9727-8755ddbb6bfa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:25.542610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-005e6d61-99bd-4b81-9727-8755ddbb6bfa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:25.547560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-005e6d61-99bd-4b81-9727-8755ddbb6bfa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:25.548071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-005e6d61-99bd-4b81-9727-8755ddbb6bfa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:25.787615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-005e6d61-99bd-4b81-9727-8755ddbb6bfa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:25.798363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-005e6d61-99bd-4b81-9727-8755ddbb6bfa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.278431 Jul 27 20:15:25.799176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 134/270] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:25 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:26.843980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e1e41f00-0065-4a85-95fa-1868e05deb9a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:26.850794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e1e41f00-0065-4a85-95fa-1868e05deb9a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:26.868689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1e41f00-0065-4a85-95fa-1868e05deb9a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:26.872108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1e41f00-0065-4a85-95fa-1868e05deb9a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:26.878388 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1e41f00-0065-4a85-95fa-1868e05deb9a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:26.885028 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1e41f00-0065-4a85-95fa-1868e05deb9a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:27.300116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e1e41f00-0065-4a85-95fa-1868e05deb9a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:27.362505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e1e41f00-0065-4a85-95fa-1868e05deb9a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.531674 Jul 27 20:15:27.366610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 137/271] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:26 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:28.135026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1310799186", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f744f7bc-35f9-4947-a9a1-81fcf2e819d6"}], "security_groups": [{"name": "tempest-securitygroup--134056626"}], "key_name": "tempest-keypair-275638179", "user_data": "}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:28.278854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] validate_networks() for [('f744f7bc-35f9-4947-a9a1-81fcf2e819d6', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:15:28.391605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-975f875c-27fc-4847-843c-a2af6683a88f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:28.392539 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-975f875c-27fc-4847-843c-a2af6683a88f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:28.399686 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:28.401624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-975f875c-27fc-4847-843c-a2af6683a88f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:28.402365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-975f875c-27fc-4847-843c-a2af6683a88f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:28.403087 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-975f875c-27fc-4847-843c-a2af6683a88f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:28.403673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-975f875c-27fc-4847-843c-a2af6683a88f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:28.926401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-975f875c-27fc-4847-843c-a2af6683a88f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:28.939781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-975f875c-27fc-4847-843c-a2af6683a88f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.549729 Jul 27 20:15:28.939781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 138/272] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:28 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:29.143803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:15:29.144278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:15:29.144703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:15:29.145161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:15:29.145568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:15:29.160004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:29.160298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:29.161176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:29.161611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:29.181661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Getting quotas for project a74675480e734145a1692641342c3e99. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:15:29.185996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Getting quotas for user caca4eade01642af9322aa72f7443726 and project a74675480e734145a1692641342c3e99. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:15:29.198454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:15:29.201137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:15:29.284688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d49efcca-8795-4616-87b6-f9de26a8396f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.153965 Jul 27 20:15:29.285338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 135/273] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Jul 27 20:15:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 20:15:29.296885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7f301117-da59-4413-89d3-4d24a5985b09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:29.297495 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7f301117-da59-4413-89d3-4d24a5985b09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:29.376287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7f301117-da59-4413-89d3-4d24a5985b09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:29.383564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7f301117-da59-4413-89d3-4d24a5985b09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:29.385136 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7f301117-da59-4413-89d3-4d24a5985b09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:29.386705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7f301117-da59-4413-89d3-4d24a5985b09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1281 microversion: 2.20 time: 0.093685 Jul 27 20:15:29.387269 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 139/274] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:29 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:29.958586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eb77aaf9-d0c8-44c3-8229-2c5c24cc4521 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:29.959381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eb77aaf9-d0c8-44c3-8229-2c5c24cc4521 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:29.966144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb77aaf9-d0c8-44c3-8229-2c5c24cc4521 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:29.966608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb77aaf9-d0c8-44c3-8229-2c5c24cc4521 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:29.967382 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb77aaf9-d0c8-44c3-8229-2c5c24cc4521 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:29.967821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb77aaf9-d0c8-44c3-8229-2c5c24cc4521 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.169351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eb77aaf9-d0c8-44c3-8229-2c5c24cc4521 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:30.178742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eb77aaf9-d0c8-44c3-8229-2c5c24cc4521 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.223867 Jul 27 20:15:30.179851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 136/275] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:29 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:30.250905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2043792642", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:30.306064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] validate_networks() for None {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:15:30.409497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:30.410164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:30.412120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:30.416798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.417239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.418013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.418435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.528559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:30.536978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:30.538491 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:30.539668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b6b68a44-9fe7-49ab-8ad0-59a71ab74091 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1285 microversion: 2.20 time: 0.134496 Jul 27 20:15:30.540248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 137/276] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:15:30.719866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:15:30.720127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:15:30.720785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:15:30.721196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:15:30.721634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:15:30.731090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.731776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.732756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.733221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.750763 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Getting quotas for project 370ac8b4f98e45f5940e643b3afa6be3. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:15:30.754797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Getting quotas for user 412828a7f19c451a9784f370f84c37ec and project 370ac8b4f98e45f5940e643b3afa6be3. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:15:30.765664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:15:30.767907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:15:30.923971 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-532a789f-eaa7-4ea7-ab59-56084d8f098a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678344 Jul 27 20:15:30.924661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 140/277] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:15:30.936274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-617c1183-d4eb-4b5d-ac71-4ab9c6c785f9 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:30.937009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-617c1183-d4eb-4b5d-ac71-4ab9c6c785f9 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:30.939410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7e64f8d2-4db1-4c13-a2f2-68298a82f3d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:30.940159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7e64f8d2-4db1-4c13-a2f2-68298a82f3d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:30.947022 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e64f8d2-4db1-4c13-a2f2-68298a82f3d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.947459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e64f8d2-4db1-4c13-a2f2-68298a82f3d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.948230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e64f8d2-4db1-4c13-a2f2-68298a82f3d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.948938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e64f8d2-4db1-4c13-a2f2-68298a82f3d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.973464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7e64f8d2-4db1-4c13-a2f2-68298a82f3d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/ips" status: 200 len: 146 microversion: 2.1 time: 0.038052 Jul 27 20:15:30.976043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 141/278] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:15:30 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:30.995827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-617c1183-d4eb-4b5d-ac71-4ab9c6c785f9 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:31.003777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-617c1183-d4eb-4b5d-ac71-4ab9c6c785f9 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1215 microversion: 2.1 time: 0.071481 Jul 27 20:15:31.004456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 138/279] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:30 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:31.205576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ea5b9426-36e6-44c4-be61-13774d3f7745 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:31.206191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ea5b9426-36e6-44c4-be61-13774d3f7745 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:31.213662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea5b9426-36e6-44c4-be61-13774d3f7745 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:31.213662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea5b9426-36e6-44c4-be61-13774d3f7745 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:31.214268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea5b9426-36e6-44c4-be61-13774d3f7745 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:31.214714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea5b9426-36e6-44c4-be61-13774d3f7745 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:31.351227 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ea5b9426-36e6-44c4-be61-13774d3f7745 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:31.358964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ea5b9426-36e6-44c4-be61-13774d3f7745 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.157328 Jul 27 20:15:31.360034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 142/280] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:31 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:31.562232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:31.562821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:31.569810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:31.570252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:31.575851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:31.575851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:31.631884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:31.639722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:31.641263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:31.643440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6a4e0956-aa8d-43ec-ad82-7febf4c4916a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1277 microversion: 2.20 time: 0.084092 Jul 27 20:15:31.643440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 139/281] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:31 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:32.028926 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-964389ca-e5de-44dd-abaf-4b9630479c7f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:32.029546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-964389ca-e5de-44dd-abaf-4b9630479c7f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:32.046272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-964389ca-e5de-44dd-abaf-4b9630479c7f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:32.046272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-964389ca-e5de-44dd-abaf-4b9630479c7f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:32.046272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-964389ca-e5de-44dd-abaf-4b9630479c7f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:32.046272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-964389ca-e5de-44dd-abaf-4b9630479c7f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:32.119110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-964389ca-e5de-44dd-abaf-4b9630479c7f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:32.126453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-964389ca-e5de-44dd-abaf-4b9630479c7f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1219 microversion: 2.1 time: 0.101913 Jul 27 20:15:32.140368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 143/282] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:32 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:32.380356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-42eae4fe-13cf-4480-b799-6634ea12ed9f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:32.380926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-42eae4fe-13cf-4480-b799-6634ea12ed9f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:32.386940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42eae4fe-13cf-4480-b799-6634ea12ed9f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:32.401573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42eae4fe-13cf-4480-b799-6634ea12ed9f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:32.401573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42eae4fe-13cf-4480-b799-6634ea12ed9f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:32.401573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42eae4fe-13cf-4480-b799-6634ea12ed9f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:32.516587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-42eae4fe-13cf-4480-b799-6634ea12ed9f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:32.524273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-42eae4fe-13cf-4480-b799-6634ea12ed9f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.147871 Jul 27 20:15:32.524884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 140/283] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:32 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:32.668171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:32.668808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:32.675250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:32.675673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:32.681298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:32.681298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:32.739139 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:32.747736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:32.749445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:32.750552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1e010cf0-6751-4e89-a0d6-2213f96541da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1333 microversion: 2.20 time: 0.086301 Jul 27 20:15:32.751111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 144/284] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:32 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:33.147503 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-64991f47-f154-41a4-9449-b5b0b225447a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:33.148121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-64991f47-f154-41a4-9449-b5b0b225447a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:33.154515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64991f47-f154-41a4-9449-b5b0b225447a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.154963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64991f47-f154-41a4-9449-b5b0b225447a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.155707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64991f47-f154-41a4-9449-b5b0b225447a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.156138 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64991f47-f154-41a4-9449-b5b0b225447a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.218461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64991f47-f154-41a4-9449-b5b0b225447a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:33.226606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-64991f47-f154-41a4-9449-b5b0b225447a tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1267 microversion: 2.1 time: 0.083482 Jul 27 20:15:33.227258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 141/285] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:33 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:33.546911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-81ccb23b-2f78-4e4e-8939-912fcf736913 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:33.547527 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-81ccb23b-2f78-4e4e-8939-912fcf736913 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:33.554010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81ccb23b-2f78-4e4e-8939-912fcf736913 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.554513 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81ccb23b-2f78-4e4e-8939-912fcf736913 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.555265 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81ccb23b-2f78-4e4e-8939-912fcf736913 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.555696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81ccb23b-2f78-4e4e-8939-912fcf736913 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.679796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-81ccb23b-2f78-4e4e-8939-912fcf736913 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:33.687111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-81ccb23b-2f78-4e4e-8939-912fcf736913 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.144196 Jul 27 20:15:33.687672 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 145/286] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:33 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:33.772802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:33.773318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:33.779262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.779706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.780497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.780933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.784929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:33.840613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:33.848678 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:33.850694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:33.851784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3139922f-cb54-4e58-828c-ad7feca6eb7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1341 microversion: 2.20 time: 0.082952 Jul 27 20:15:33.852352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 142/287] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:33 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1341 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:34.247178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3773a779-c8eb-4c35-962d-bd6099a84e49 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:34.247779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3773a779-c8eb-4c35-962d-bd6099a84e49 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:34.253708 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3773a779-c8eb-4c35-962d-bd6099a84e49 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.254149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3773a779-c8eb-4c35-962d-bd6099a84e49 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.254885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3773a779-c8eb-4c35-962d-bd6099a84e49 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.255313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3773a779-c8eb-4c35-962d-bd6099a84e49 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.316660 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3773a779-c8eb-4c35-962d-bd6099a84e49 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:34.324038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3773a779-c8eb-4c35-962d-bd6099a84e49 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1267 microversion: 2.1 time: 0.080932 Jul 27 20:15:34.324633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 146/288] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:34 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:34.708920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-653313ed-de2a-490a-9818-ff7df2557d0b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:34.710162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-653313ed-de2a-490a-9818-ff7df2557d0b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:34.716967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-653313ed-de2a-490a-9818-ff7df2557d0b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.717411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-653313ed-de2a-490a-9818-ff7df2557d0b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.718187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-653313ed-de2a-490a-9818-ff7df2557d0b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.718623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-653313ed-de2a-490a-9818-ff7df2557d0b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.849102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-653313ed-de2a-490a-9818-ff7df2557d0b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:34.856665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-653313ed-de2a-490a-9818-ff7df2557d0b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.151961 Jul 27 20:15:34.857242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 143/289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:34 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:34.874407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:34.875050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:34.881083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.882196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.882947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.883377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.946915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:34.949779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:34.957368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:34.958880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:34.960119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4a7156ae-7892-4079-9131-c2438d84bdd8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1341 microversion: 2.20 time: 0.089514 Jul 27 20:15:34.960651 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 147/290] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:35.345208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cbbcf57e-bcb2-4cb5-8337-6d2c76895d1e tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:35.345820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cbbcf57e-bcb2-4cb5-8337-6d2c76895d1e tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:35.352435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbbcf57e-bcb2-4cb5-8337-6d2c76895d1e tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.352884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbbcf57e-bcb2-4cb5-8337-6d2c76895d1e tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:35.353634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbbcf57e-bcb2-4cb5-8337-6d2c76895d1e tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.354066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbbcf57e-bcb2-4cb5-8337-6d2c76895d1e tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:35.415733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cbbcf57e-bcb2-4cb5-8337-6d2c76895d1e tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:35.423261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cbbcf57e-bcb2-4cb5-8337-6d2c76895d1e tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1267 microversion: 2.1 time: 0.081843 Jul 27 20:15:35.424303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 144/291] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:35 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:35.878405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7499677d-fb79-406d-86a8-8d1a497f2230 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:35.881799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7499677d-fb79-406d-86a8-8d1a497f2230 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:35.886270 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7499677d-fb79-406d-86a8-8d1a497f2230 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.886895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7499677d-fb79-406d-86a8-8d1a497f2230 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:35.887680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7499677d-fb79-406d-86a8-8d1a497f2230 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.888119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7499677d-fb79-406d-86a8-8d1a497f2230 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:35.983253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:35.984765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:35.993459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.995112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:35.995927 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.996393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:36.081079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:36.089690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:36.091189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:36.092322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-617b25ee-0cb2-41ac-9a4a-ea3d279cb88b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1341 microversion: 2.20 time: 0.113888 Jul 27 20:15:36.092931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 145/292] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:35 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1341 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:36.095663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7499677d-fb79-406d-86a8-8d1a497f2230 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:36.103182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7499677d-fb79-406d-86a8-8d1a497f2230 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.229501 Jul 27 20:15:36.103740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 148/293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:35 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:36.444990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-685d07b2-3ebb-469a-856e-97199edf2455 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:36.445756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-685d07b2-3ebb-469a-856e-97199edf2455 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:36.460750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-685d07b2-3ebb-469a-856e-97199edf2455 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:36.460750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-685d07b2-3ebb-469a-856e-97199edf2455 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:36.460750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-685d07b2-3ebb-469a-856e-97199edf2455 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:36.460750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-685d07b2-3ebb-469a-856e-97199edf2455 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:36.545826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-685d07b2-3ebb-469a-856e-97199edf2455 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:36.554591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-685d07b2-3ebb-469a-856e-97199edf2455 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1267 microversion: 2.1 time: 0.114092 Jul 27 20:15:36.555359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 146/294] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:36 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:37.115408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:37.116078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:37.122688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.123113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:37.123412 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4b427e79-8652-4a7d-bdfc-6f4a4cbac354 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:37.123919 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.124165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4b427e79-8652-4a7d-bdfc-6f4a4cbac354 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:37.124697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:37.133286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b427e79-8652-4a7d-bdfc-6f4a4cbac354 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.134021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b427e79-8652-4a7d-bdfc-6f4a4cbac354 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:37.135529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b427e79-8652-4a7d-bdfc-6f4a4cbac354 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.136168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b427e79-8652-4a7d-bdfc-6f4a4cbac354 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:37.401698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:37.408161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4b427e79-8652-4a7d-bdfc-6f4a4cbac354 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:37.415355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:37.417338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:37.424351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f9748486-ecb5-43b3-ac81-3c73611ffe9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.308645 Jul 27 20:15:37.424542 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4b427e79-8652-4a7d-bdfc-6f4a4cbac354 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.300356 Jul 27 20:15:37.424645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 149/295] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:37.424735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 147/296] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:37 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:37.575972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e3191467-50bd-410f-a285-4e24d68e4c3f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:37.576627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e3191467-50bd-410f-a285-4e24d68e4c3f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:37.583682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3191467-50bd-410f-a285-4e24d68e4c3f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.584137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3191467-50bd-410f-a285-4e24d68e4c3f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:37.585506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3191467-50bd-410f-a285-4e24d68e4c3f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.585939 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3191467-50bd-410f-a285-4e24d68e4c3f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:37.660049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e3191467-50bd-410f-a285-4e24d68e4c3f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:37.665678 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e3191467-50bd-410f-a285-4e24d68e4c3f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1275 microversion: 2.1 time: 0.093433 Jul 27 20:15:37.666241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 150/297] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:37 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:38.442983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c6cc74ae-40fc-4b25-a715-7ab350e23e64 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:38.443519 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c6cc74ae-40fc-4b25-a715-7ab350e23e64 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:38.445720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:38.446332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:38.450564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6cc74ae-40fc-4b25-a715-7ab350e23e64 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:38.451119 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6cc74ae-40fc-4b25-a715-7ab350e23e64 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:38.451985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6cc74ae-40fc-4b25-a715-7ab350e23e64 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:38.452314 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:38.452774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6cc74ae-40fc-4b25-a715-7ab350e23e64 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:38.452885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:38.453589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:38.454027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:38.645938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:38.650614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c6cc74ae-40fc-4b25-a715-7ab350e23e64 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:38.655026 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:38.656619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:38.657722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7be7b607-6ebf-4714-b358-a75eac621f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.215840 Jul 27 20:15:38.657952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c6cc74ae-40fc-4b25-a715-7ab350e23e64 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.218805 Jul 27 20:15:38.658318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 151/298] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:38 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:15:38.660426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 148/299] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:38 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:38.686728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aee4f6db-4ce1-4b39-b1ed-534ed4800187 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:38.687440 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aee4f6db-4ce1-4b39-b1ed-534ed4800187 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:38.693535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aee4f6db-4ce1-4b39-b1ed-534ed4800187 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:38.693933 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aee4f6db-4ce1-4b39-b1ed-534ed4800187 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:38.694717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aee4f6db-4ce1-4b39-b1ed-534ed4800187 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:38.695158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aee4f6db-4ce1-4b39-b1ed-534ed4800187 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:38.754003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aee4f6db-4ce1-4b39-b1ed-534ed4800187 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:38.761321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aee4f6db-4ce1-4b39-b1ed-534ed4800187 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1275 microversion: 2.1 time: 0.078341 Jul 27 20:15:38.761893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 152/300] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:38 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1275 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:39.679798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-91d2a2f0-04f4-47c8-8e72-740a755e0d38 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:39.681202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-91d2a2f0-04f4-47c8-8e72-740a755e0d38 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:39.681720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:39.682332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:39.684220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:39.688742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.691050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91d2a2f0-04f4-47c8-8e72-740a755e0d38 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.691169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.691283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91d2a2f0-04f4-47c8-8e72-740a755e0d38 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.691367 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.691472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91d2a2f0-04f4-47c8-8e72-740a755e0d38 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.691639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.691735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91d2a2f0-04f4-47c8-8e72-740a755e0d38 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.876610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:39.883552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91d2a2f0-04f4-47c8-8e72-740a755e0d38 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:39.884546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:39.886067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:39.887169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f20a172f-5c91-47cf-8a78-113b782e8b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.210021 Jul 27 20:15:39.887725 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 153/301] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:39 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:39.892263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-98e7c015-3bda-453f-921d-c80cc158cfc3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:39.892889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-98e7c015-3bda-453f-921d-c80cc158cfc3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:39.898496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-91d2a2f0-04f4-47c8-8e72-740a755e0d38 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.223235 Jul 27 20:15:39.899065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98e7c015-3bda-453f-921d-c80cc158cfc3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.899192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 149/302] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:39 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:39.899766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98e7c015-3bda-453f-921d-c80cc158cfc3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.900566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98e7c015-3bda-453f-921d-c80cc158cfc3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.901001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98e7c015-3bda-453f-921d-c80cc158cfc3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.961193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-98e7c015-3bda-453f-921d-c80cc158cfc3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:39.968341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-98e7c015-3bda-453f-921d-c80cc158cfc3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1275 microversion: 2.1 time: 0.079458 Jul 27 20:15:39.968929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 154/303] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:39 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1275 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:40.910409 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:40.911086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:40.915901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:40.916859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=12 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:40.920720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f84d0f47-bee0-4489-b555-5ce2355885cf tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:40.921352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f84d0f47-bee0-4489-b555-5ce2355885cf tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:40.925521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:40.926829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:40.926829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:40.927437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:40.928076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f84d0f47-bee0-4489-b555-5ce2355885cf tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:40.928564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f84d0f47-bee0-4489-b555-5ce2355885cf tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:40.929824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f84d0f47-bee0-4489-b555-5ce2355885cf tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:40.930252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f84d0f47-bee0-4489-b555-5ce2355885cf tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:41.000693 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=8 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:41.596291 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:41.604149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:41.605716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:41.606877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-356fe9ae-5f0a-4684-b59d-2062838dde2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.700915 Jul 27 20:15:41.607437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 150/304] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:15:41.621652 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f84d0f47-bee0-4489-b555-5ce2355885cf tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:41.626960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-57f6dc22-e499-456e-870b-960b8a43c899 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:41.627799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-57f6dc22-e499-456e-870b-960b8a43c899 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:41.632364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f84d0f47-bee0-4489-b555-5ce2355885cf tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.716734 Jul 27 20:15:41.633389 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 155/305] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:40 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:41.635517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57f6dc22-e499-456e-870b-960b8a43c899 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:41.636123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57f6dc22-e499-456e-870b-960b8a43c899 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:41.637437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57f6dc22-e499-456e-870b-960b8a43c899 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:41.638437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57f6dc22-e499-456e-870b-960b8a43c899 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:41.675601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-503efc1a-6e04-476f-9332-368c94240def req-eac09521-251f-4f7e-ac42-e6a4fb164db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0929536d-2d91-4e59-8f36-474025d921ef", "tag": "39cce058-68c6-4a18-8354-201c5dba75c7"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:41.687810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-503efc1a-6e04-476f-9332-368c94240def req-eac09521-251f-4f7e-ac42-e6a4fb164db5 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:41.688248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-503efc1a-6e04-476f-9332-368c94240def req-eac09521-251f-4f7e-ac42-e6a4fb164db5 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:41.735353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-57f6dc22-e499-456e-870b-960b8a43c899 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:41.750493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-57f6dc22-e499-456e-870b-960b8a43c899 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1273 microversion: 2.1 time: 0.140969 Jul 27 20:15:41.758084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 151/306] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:41 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:41.870463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-503efc1a-6e04-476f-9332-368c94240def req-eac09521-251f-4f7e-ac42-e6a4fb164db5 service nova] Creating event network-changed:39cce058-68c6-4a18-8354-201c5dba75c7 for instance 0929536d-2d91-4e59-8f36-474025d921ef on hv-cinder-85124 Jul 27 20:15:41.876248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-503efc1a-6e04-476f-9332-368c94240def req-eac09521-251f-4f7e-ac42-e6a4fb164db5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205456 Jul 27 20:15:41.877192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 156/307] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:42.630504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:42.634681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:42.642384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.642825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.643777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.644491 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.662276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5e3cc25f-e7ad-4cc8-9414-f990d405fba7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:42.663806 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5e3cc25f-e7ad-4cc8-9414-f990d405fba7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:42.672462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e3cc25f-e7ad-4cc8-9414-f990d405fba7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.672940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e3cc25f-e7ad-4cc8-9414-f990d405fba7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.673702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e3cc25f-e7ad-4cc8-9414-f990d405fba7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.674993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e3cc25f-e7ad-4cc8-9414-f990d405fba7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.917601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:42.927331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:42.933411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:42.933411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8f0d0f25-d423-493d-ba06-a33e12bc598b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.304705 Jul 27 20:15:42.933411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 152/308] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:42.937766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d9ca3a67-e8b3-4da7-9c35-b09efc949d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8672d324-9e51-4d4b-a2d4-3fa31e947ccc"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:42.940885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d9ca3a67-e8b3-4da7-9c35-b09efc949d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:42.947994 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9ca3a67-e8b3-4da7-9c35-b09efc949d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.948554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9ca3a67-e8b3-4da7-9c35-b09efc949d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.949332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9ca3a67-e8b3-4da7-9c35-b09efc949d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.949769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9ca3a67-e8b3-4da7-9c35-b09efc949d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.960758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5e3cc25f-e7ad-4cc8-9414-f990d405fba7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:42.977228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5e3cc25f-e7ad-4cc8-9414-f990d405fba7 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.321410 Jul 27 20:15:42.991364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 157/309] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:42 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:42.996951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f9a4eecb-807e-4d33-8477-646b0a8e4fa5 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:42.997765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f9a4eecb-807e-4d33-8477-646b0a8e4fa5 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:43.009020 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9a4eecb-807e-4d33-8477-646b0a8e4fa5 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:43.009730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9a4eecb-807e-4d33-8477-646b0a8e4fa5 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:43.010904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9a4eecb-807e-4d33-8477-646b0a8e4fa5 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:43.011805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9a4eecb-807e-4d33-8477-646b0a8e4fa5 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:43.177873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9a4eecb-807e-4d33-8477-646b0a8e4fa5 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:43.185391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f9a4eecb-807e-4d33-8477-646b0a8e4fa5 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.192432 Jul 27 20:15:43.185953 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 158/310] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:42 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:43.654328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cfe7536f-1ee3-41f0-b87b-a7cccb7fe52b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "775182ec-38f5-490e-a7c2-cd247c8081ba", "device": "/dev/sdb"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:43.657147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cfe7536f-1ee3-41f0-b87b-a7cccb7fe52b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:43.662970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfe7536f-1ee3-41f0-b87b-a7cccb7fe52b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:43.663577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfe7536f-1ee3-41f0-b87b-a7cccb7fe52b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:43.664173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfe7536f-1ee3-41f0-b87b-a7cccb7fe52b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:43.664625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfe7536f-1ee3-41f0-b87b-a7cccb7fe52b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:44.657930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d9ca3a67-e8b3-4da7-9c35-b09efc949d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "POST /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.724957 Jul 27 20:15:44.658539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 153/311] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:15:42 2022] POST /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments => generated 194 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:44.664112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-4be7bf24-30fe-450c-ab3c-96d7956649a0 req-0f982d83-9fa5-45fe-91cd-f9184d28bd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736967d7-db62-4dcb-9a61-83fb767d6179", "tag": "32b0ae84-ead4-4da7-8300-e17221984e66"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:44.674947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-4be7bf24-30fe-450c-ab3c-96d7956649a0 req-0f982d83-9fa5-45fe-91cd-f9184d28bd29 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:44.677166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-4be7bf24-30fe-450c-ab3c-96d7956649a0 req-0f982d83-9fa5-45fe-91cd-f9184d28bd29 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:44.687225 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-4be7bf24-30fe-450c-ab3c-96d7956649a0 req-0f982d83-9fa5-45fe-91cd-f9184d28bd29 service nova] Creating event network-changed:32b0ae84-ead4-4da7-8300-e17221984e66 for instance 736967d7-db62-4dcb-9a61-83fb767d6179 on hv-cinder-85124 Jul 27 20:15:44.691954 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-4be7bf24-30fe-450c-ab3c-96d7956649a0 req-0f982d83-9fa5-45fe-91cd-f9184d28bd29 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031791 Jul 27 20:15:44.692589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 154/312] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:44.699722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:44.701063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:44.709415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:44.711536 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:44.711536 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:44.711536 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:44.855323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:44.863796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:44.865451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:44.867305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-732e6ac0-3794-41c5-8dba-fcbbb47e04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.173424 Jul 27 20:15:44.872327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 155/313] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:44.874033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f7ca4064-b6e9-4bbc-a0cb-084a970a8f88 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:44.874643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f7ca4064-b6e9-4bbc-a0cb-084a970a8f88 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:44.880956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7ca4064-b6e9-4bbc-a0cb-084a970a8f88 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:44.881407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7ca4064-b6e9-4bbc-a0cb-084a970a8f88 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:44.882747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7ca4064-b6e9-4bbc-a0cb-084a970a8f88 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:44.883177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7ca4064-b6e9-4bbc-a0cb-084a970a8f88 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:45.015457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cfe7536f-1ee3-41f0-b87b-a7cccb7fe52b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "POST /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.361552 Jul 27 20:15:45.015457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 159/314] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:15:43 2022] POST /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4/os-volume_attachments => generated 194 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:45.015874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f7ca4064-b6e9-4bbc-a0cb-084a970a8f88 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:45.022971 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9381f5de-04af-4397-936d-b0811d70b451 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:45.023934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9381f5de-04af-4397-936d-b0811d70b451 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:45.024899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f7ca4064-b6e9-4bbc-a0cb-084a970a8f88 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.155631 Jul 27 20:15:45.025545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 156/315] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:44 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:45.031698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9381f5de-04af-4397-936d-b0811d70b451 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:45.032148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9381f5de-04af-4397-936d-b0811d70b451 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:45.033255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9381f5de-04af-4397-936d-b0811d70b451 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:45.033885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9381f5de-04af-4397-936d-b0811d70b451 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:45.181681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9381f5de-04af-4397-936d-b0811d70b451 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:45.189149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9381f5de-04af-4397-936d-b0811d70b451 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.175084 Jul 27 20:15:45.189583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 160/316] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:45 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:45.895720 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:45.896697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:45.907400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:45.907922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:45.908988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:45.909623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:46.049038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-58d05456-70cb-4f1a-9bab-71b57bb796be tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:46.049038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-58d05456-70cb-4f1a-9bab-71b57bb796be tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:46.059763 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58d05456-70cb-4f1a-9bab-71b57bb796be tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:46.059763 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58d05456-70cb-4f1a-9bab-71b57bb796be tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:46.066046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58d05456-70cb-4f1a-9bab-71b57bb796be tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:46.067816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58d05456-70cb-4f1a-9bab-71b57bb796be tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:46.193702 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:46.202656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:46.204540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:46.205649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-31f1110a-b809-46fd-a533-0a9edbedec55 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.316376 Jul 27 20:15:46.206506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 157/317] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:45 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:46.211404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2f13bbe8-6202-4974-985e-4ede370ad1ec tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:46.212191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2f13bbe8-6202-4974-985e-4ede370ad1ec tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:46.218847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f13bbe8-6202-4974-985e-4ede370ad1ec tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:46.219523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f13bbe8-6202-4974-985e-4ede370ad1ec tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:46.220675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f13bbe8-6202-4974-985e-4ede370ad1ec tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:46.221117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f13bbe8-6202-4974-985e-4ede370ad1ec tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:46.225768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:46.244037 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-58d05456-70cb-4f1a-9bab-71b57bb796be tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:46.251608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-58d05456-70cb-4f1a-9bab-71b57bb796be tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.208294 Jul 27 20:15:46.252180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 161/318] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:46 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:46.391699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2f13bbe8-6202-4974-985e-4ede370ad1ec tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:46.399251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2f13bbe8-6202-4974-985e-4ede370ad1ec tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.191710 Jul 27 20:15:46.399831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 158/319] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:46 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:47.232546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:47.232546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:47.235654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.236108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.236912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.237352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.274296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-000caa88-9738-401c-ae87-5f76f3546247 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:47.275758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-000caa88-9738-401c-ae87-5f76f3546247 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:47.283079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-000caa88-9738-401c-ae87-5f76f3546247 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.284228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-000caa88-9738-401c-ae87-5f76f3546247 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.284341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-000caa88-9738-401c-ae87-5f76f3546247 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.284735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-000caa88-9738-401c-ae87-5f76f3546247 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.548812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:47.559241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:47.561101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-000caa88-9738-401c-ae87-5f76f3546247 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:47.561270 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:47.562602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a70202d3-30d9-4cac-9fb9-34ff01c971e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.339185 Jul 27 20:15:47.563587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 162/320] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:47.576209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-000caa88-9738-401c-ae87-5f76f3546247 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.306503 Jul 27 20:15:47.576447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-980657f4-c8fe-42f2-8a7d-91daa3de9b37 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:47.577222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 159/321] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:47 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:47.578830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-980657f4-c8fe-42f2-8a7d-91daa3de9b37 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:47.585106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-980657f4-c8fe-42f2-8a7d-91daa3de9b37 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.585546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-980657f4-c8fe-42f2-8a7d-91daa3de9b37 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.586983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-980657f4-c8fe-42f2-8a7d-91daa3de9b37 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.587551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-980657f4-c8fe-42f2-8a7d-91daa3de9b37 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.721742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-980657f4-c8fe-42f2-8a7d-91daa3de9b37 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:47.724038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:47.730575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-980657f4-c8fe-42f2-8a7d-91daa3de9b37 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.165964 Jul 27 20:15:47.731220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 163/322] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:47 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:48.586058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:48.586658 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:48.593146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.593760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.594507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.594947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.598279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ab115609-b22c-4ab3-b66d-9a1ea2bb4eaa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:48.598916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ab115609-b22c-4ab3-b66d-9a1ea2bb4eaa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:48.606380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ab115609-b22c-4ab3-b66d-9a1ea2bb4eaa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.606830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ab115609-b22c-4ab3-b66d-9a1ea2bb4eaa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.607586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ab115609-b22c-4ab3-b66d-9a1ea2bb4eaa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.608041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ab115609-b22c-4ab3-b66d-9a1ea2bb4eaa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.802763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:48.806331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ab115609-b22c-4ab3-b66d-9a1ea2bb4eaa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:48.811462 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:48.813014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:48.814117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f80bf65b-a5d9-4c0c-929e-d596419152c0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.232036 Jul 27 20:15:48.814218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ab115609-b22c-4ab3-b66d-9a1ea2bb4eaa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.219690 Jul 27 20:15:48.814685 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 160/324] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:48 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:48.814776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 164/324] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:48 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:48.819063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6b75fc97-4a55-42f1-9b78-3f2f30a72194 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:48.819665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6b75fc97-4a55-42f1-9b78-3f2f30a72194 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:48.826066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b75fc97-4a55-42f1-9b78-3f2f30a72194 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.826516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b75fc97-4a55-42f1-9b78-3f2f30a72194 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.827278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b75fc97-4a55-42f1-9b78-3f2f30a72194 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.827712 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b75fc97-4a55-42f1-9b78-3f2f30a72194 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.957379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6b75fc97-4a55-42f1-9b78-3f2f30a72194 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:48.965367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6b75fc97-4a55-42f1-9b78-3f2f30a72194 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.149715 Jul 27 20:15:48.969753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 161/325] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:48 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:49.838401 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:49.839087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:49.840231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ed88d0ff-ee2f-4cb7-ae4f-bc41b730b5c8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:49.840865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ed88d0ff-ee2f-4cb7-ae4f-bc41b730b5c8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:49.845969 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:49.846426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:49.847170 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed88d0ff-ee2f-4cb7-ae4f-bc41b730b5c8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:49.847286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:49.847608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:49.847704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed88d0ff-ee2f-4cb7-ae4f-bc41b730b5c8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:49.848352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed88d0ff-ee2f-4cb7-ae4f-bc41b730b5c8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:49.848808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed88d0ff-ee2f-4cb7-ae4f-bc41b730b5c8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:50.039635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:50.047259 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ed88d0ff-ee2f-4cb7-ae4f-bc41b730b5c8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:50.047847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:50.049379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:50.050558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-af1a56de-a078-4c05-8121-bd4566d10212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.216142 Jul 27 20:15:50.051113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 162/326] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:15:50.055448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ed88d0ff-ee2f-4cb7-ae4f-bc41b730b5c8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.220588 Jul 27 20:15:50.056243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-39d8c61d-cd84-4251-92f0-54bfc67054f4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:50.056447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 165/327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:49 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:50.057185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39d8c61d-cd84-4251-92f0-54bfc67054f4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:50.063892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39d8c61d-cd84-4251-92f0-54bfc67054f4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:50.064509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39d8c61d-cd84-4251-92f0-54bfc67054f4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:50.065262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39d8c61d-cd84-4251-92f0-54bfc67054f4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:50.065690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39d8c61d-cd84-4251-92f0-54bfc67054f4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:50.200046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-39d8c61d-cd84-4251-92f0-54bfc67054f4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:50.207409 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-39d8c61d-cd84-4251-92f0-54bfc67054f4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.155127 Jul 27 20:15:50.207915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 163/328] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:50 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:50.320070 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-acaccf44-b62c-40ca-a325-1b00b7cb09ab req-e78ee61d-10bf-4432-896e-2d3b8a7fa1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0929536d-2d91-4e59-8f36-474025d921ef", "name": "network-vif-plugged", "status": "completed", "tag": "39cce058-68c6-4a18-8354-201c5dba75c7"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:50.329646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-acaccf44-b62c-40ca-a325-1b00b7cb09ab req-e78ee61d-10bf-4432-896e-2d3b8a7fa1b5 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:50.330095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-acaccf44-b62c-40ca-a325-1b00b7cb09ab req-e78ee61d-10bf-4432-896e-2d3b8a7fa1b5 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:50.342064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-acaccf44-b62c-40ca-a325-1b00b7cb09ab req-e78ee61d-10bf-4432-896e-2d3b8a7fa1b5 service nova] Creating event network-vif-plugged:39cce058-68c6-4a18-8354-201c5dba75c7 for instance 0929536d-2d91-4e59-8f36-474025d921ef on hv-cinder-85124 Jul 27 20:15:50.347447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-acaccf44-b62c-40ca-a325-1b00b7cb09ab req-e78ee61d-10bf-4432-896e-2d3b8a7fa1b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031082 Jul 27 20:15:50.348035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 166/329] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:51.078427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e1caf1f0-81ce-4b0e-9a3e-b6962c5b5655 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:51.080064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e1caf1f0-81ce-4b0e-9a3e-b6962c5b5655 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:51.085645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:51.086958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:51.088358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1caf1f0-81ce-4b0e-9a3e-b6962c5b5655 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:51.088852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1caf1f0-81ce-4b0e-9a3e-b6962c5b5655 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:51.089611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1caf1f0-81ce-4b0e-9a3e-b6962c5b5655 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:51.090739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1caf1f0-81ce-4b0e-9a3e-b6962c5b5655 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:51.103548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:51.103912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:51.104695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:51.105121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:51.298769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e1caf1f0-81ce-4b0e-9a3e-b6962c5b5655 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:51.306824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e1caf1f0-81ce-4b0e-9a3e-b6962c5b5655 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.233530 Jul 27 20:15:51.307397 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 167/330] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:51 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:51.310256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:51.312161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9c5ea435-ae99-40ab-9e91-c9e09892bda4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:51.312988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9c5ea435-ae99-40ab-9e91-c9e09892bda4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:51.318926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:51.319293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c5ea435-ae99-40ab-9e91-c9e09892bda4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:51.319837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c5ea435-ae99-40ab-9e91-c9e09892bda4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:51.321115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:51.321425 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c5ea435-ae99-40ab-9e91-c9e09892bda4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:51.321857 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c5ea435-ae99-40ab-9e91-c9e09892bda4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:51.322202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-09e44bd6-c307-45e5-b036-4979f38eecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.252150 Jul 27 20:15:51.322791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 164/331] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:51.447706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9c5ea435-ae99-40ab-9e91-c9e09892bda4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:51.455150 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9c5ea435-ae99-40ab-9e91-c9e09892bda4 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.146492 Jul 27 20:15:51.455706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 168/332] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:51 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:52.327331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9307a7ad-4a5c-4c52-b307-f6742bdcd68d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:52.327872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9307a7ad-4a5c-4c52-b307-f6742bdcd68d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:52.334677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9307a7ad-4a5c-4c52-b307-f6742bdcd68d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.335138 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9307a7ad-4a5c-4c52-b307-f6742bdcd68d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.335952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9307a7ad-4a5c-4c52-b307-f6742bdcd68d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.336425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9307a7ad-4a5c-4c52-b307-f6742bdcd68d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.352630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:52.352630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:52.353185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.353735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.354719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.355223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.545721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9307a7ad-4a5c-4c52-b307-f6742bdcd68d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:52.549059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:52.564643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9307a7ad-4a5c-4c52-b307-f6742bdcd68d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1501 microversion: 2.1 time: 0.230568 Jul 27 20:15:52.564643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 165/333] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:52 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1501 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:52.564844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:52.564948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3703df99-602a-4366-ac1f-5319f1eed8e2 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:52.564948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3703df99-602a-4366-ac1f-5319f1eed8e2 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:52.565096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:52.565096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3109dec7-ad00-404f-9709-bf30541eb00c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.222141 Jul 27 20:15:52.565096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 169/334] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:52 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:15:52.566931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3703df99-602a-4366-ac1f-5319f1eed8e2 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.567379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3703df99-602a-4366-ac1f-5319f1eed8e2 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.568139 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3703df99-602a-4366-ac1f-5319f1eed8e2 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.568610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3703df99-602a-4366-ac1f-5319f1eed8e2 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.575059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "207af79a-8082-4fa3-ac56-996f5991618b"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:52.581761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:52.584503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.584944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.586059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.586499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.610994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] HTTP exception thrown: Cannot 'attach_volume' instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 while it is in vm_state rescued Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Request method failure captured: Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: POST /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5/os-volume_attachments HTTP/1.1 Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 74 Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxkHcqFutE3EAwyNg-wOR23lGSJw6Df-TrBVwl_YeaWrQCcuyV_o7y55BTu7wtbyzDU1nQcMDdYHjx8FaLCUtIH5NgZVblGVR9eBSLB-zJpYk3oEnk_fLrBVfz20mqQE3IX3kEw08ykZd38hUysPDdR_niol8cQ15JGsxxLtJXe5rM Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 2ff46475bc95496f93ad4ac4459d7cc5 Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029424536 Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:15:52.613986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ff46475bc95496f93ad4ac4459d7cc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ff46475bc95496f93ad4ac4459d7cc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2ff46475bc95496f93ad4ac4459d7cc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2ff46475bc95496f93ad4ac4459d7cc5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029424536 Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 2ff46475bc95496f93ad4ac4459d7cc5 Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029424536 Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-ServerRescueNegativeTestJSON-1029424536-project Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 77b0df6c83a84dbcb0fa5802c93dc6ae Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029424536-project Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {"volumeAttachment": {"volumeId": "207af79a-8082-4fa3-ac56-996f5991618b"}} Jul 27 20:15:52.615330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Cannot 'attach_volume' instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 while it is in vm_state rescued Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'server_id': '77d4ea93-fe33-426a-aa16-4ecfa7521db5', 'body': {'volumeAttachment': {'volumeId': '207af79a-8082-4fa3-ac56-996f5991618b'}}} Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:15:52.616082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 while it is in vm_state rescued Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:15:52.618396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:15:52.619980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:15:52.619980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:15:52.619980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 while it is in vm_state rescued Jul 27 20:15:52.619980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:15:52.619980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Returning 409 to user: Cannot 'attach_volume' instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 while it is in vm_state rescued {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:15:52.619980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e6efc9ea-3233-4938-8be7-2f4b1c04cea2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "POST /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043034 Jul 27 20:15:52.619980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 170/335] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:15:52 2022] POST /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 27 20:15:52.624636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b0552f8e-2e49-4016-be11-8fcd5dd6aa9b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:52.625166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b0552f8e-2e49-4016-be11-8fcd5dd6aa9b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:52.631796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0552f8e-2e49-4016-be11-8fcd5dd6aa9b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.637187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0552f8e-2e49-4016-be11-8fcd5dd6aa9b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.637187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0552f8e-2e49-4016-be11-8fcd5dd6aa9b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.637187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0552f8e-2e49-4016-be11-8fcd5dd6aa9b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.722679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3703df99-602a-4366-ac1f-5319f1eed8e2 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:52.730552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3703df99-602a-4366-ac1f-5319f1eed8e2 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.174353 Jul 27 20:15:52.731121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 166/336] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:52 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:52.850436 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b0552f8e-2e49-4016-be11-8fcd5dd6aa9b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "POST /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5/action" status: 202 len: 0 microversion: 2.1 time: 0.229407 Jul 27 20:15:52.850940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 171/337] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:15:52 2022] POST /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:15:52.859718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0da95ad3-7a05-4d20-adf0-81290f533908 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:52.860729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0da95ad3-7a05-4d20-adf0-81290f533908 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:52.867153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0da95ad3-7a05-4d20-adf0-81290f533908 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.867597 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0da95ad3-7a05-4d20-adf0-81290f533908 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.869105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0da95ad3-7a05-4d20-adf0-81290f533908 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.869731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0da95ad3-7a05-4d20-adf0-81290f533908 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:53.014810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0da95ad3-7a05-4d20-adf0-81290f533908 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:53.026560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0da95ad3-7a05-4d20-adf0-81290f533908 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1509 microversion: 2.1 time: 0.170827 Jul 27 20:15:53.027136 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 167/338] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:52 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:53.585613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:53.586315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:53.592533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:53.593080 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:53.593855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:53.594317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:53.731897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:53.739799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:53.741352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:53.743227 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-05a231a9-2199-46ef-8053-738ddffe71ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1406 microversion: 2.20 time: 0.162403 Jul 27 20:15:53.743787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 172/339] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:53 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:53.751619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fa9be6f4-ba6b-4120-99bc-38eb90c00b84 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:53.752227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fa9be6f4-ba6b-4120-99bc-38eb90c00b84 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:53.759333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fa9be6f4-ba6b-4120-99bc-38eb90c00b84 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:53.762440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fa9be6f4-ba6b-4120-99bc-38eb90c00b84 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:53.762440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fa9be6f4-ba6b-4120-99bc-38eb90c00b84 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:53.762440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fa9be6f4-ba6b-4120-99bc-38eb90c00b84 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:53.895419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fa9be6f4-ba6b-4120-99bc-38eb90c00b84 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:53.902987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fa9be6f4-ba6b-4120-99bc-38eb90c00b84 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.155268 Jul 27 20:15:53.903561 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 168/340] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:53 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:54.048448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-58b51c35-1094-4211-9442-23c2519a9d4e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:54.049069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-58b51c35-1094-4211-9442-23c2519a9d4e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:54.055997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58b51c35-1094-4211-9442-23c2519a9d4e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.056479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58b51c35-1094-4211-9442-23c2519a9d4e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.057246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58b51c35-1094-4211-9442-23c2519a9d4e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.057688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58b51c35-1094-4211-9442-23c2519a9d4e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.250587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-58b51c35-1094-4211-9442-23c2519a9d4e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:54.260176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-58b51c35-1094-4211-9442-23c2519a9d4e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1509 microversion: 2.1 time: 0.215537 Jul 27 20:15:54.262134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 173/341] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:54 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:54.470461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-3b615177-81bd-4ae1-9c02-efb65204cf8c req-a27ffcca-4673-45aa-89ef-e1082256d9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736967d7-db62-4dcb-9a61-83fb767d6179", "name": "network-vif-plugged", "status": "completed", "tag": "32b0ae84-ead4-4da7-8300-e17221984e66"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:54.480687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-3b615177-81bd-4ae1-9c02-efb65204cf8c req-a27ffcca-4673-45aa-89ef-e1082256d9db service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.481221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-3b615177-81bd-4ae1-9c02-efb65204cf8c req-a27ffcca-4673-45aa-89ef-e1082256d9db service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.493803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-3b615177-81bd-4ae1-9c02-efb65204cf8c req-a27ffcca-4673-45aa-89ef-e1082256d9db service nova] Creating event network-vif-plugged:32b0ae84-ead4-4da7-8300-e17221984e66 for instance 736967d7-db62-4dcb-9a61-83fb767d6179 on hv-cinder-85124 Jul 27 20:15:54.498840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-3b615177-81bd-4ae1-9c02-efb65204cf8c req-a27ffcca-4673-45aa-89ef-e1082256d9db service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032714 Jul 27 20:15:54.499431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 169/342] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:54.766855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:54.768160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:54.774877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.775401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.776271 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.776864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.925556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6ede4fdc-e788-421e-b362-5214fce46513 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:54.930341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6ede4fdc-e788-421e-b362-5214fce46513 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:54.937610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ede4fdc-e788-421e-b362-5214fce46513 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.938064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ede4fdc-e788-421e-b362-5214fce46513 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.943773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ede4fdc-e788-421e-b362-5214fce46513 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.944221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ede4fdc-e788-421e-b362-5214fce46513 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.046111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:55.050956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:55.052968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:55.055615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fed53398-7b94-419b-92c9-8708d416834f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1599 microversion: 2.20 time: 0.291692 Jul 27 20:15:55.056634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 174/343] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:15:54 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1599 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:15:55.087959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b055afc1-9e82-4609-aa43-9b5d6a712a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:55.088485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b055afc1-9e82-4609-aa43-9b5d6a712a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:55.096985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b055afc1-9e82-4609-aa43-9b5d6a712a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.097442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b055afc1-9e82-4609-aa43-9b5d6a712a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.098216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b055afc1-9e82-4609-aa43-9b5d6a712a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.098651 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b055afc1-9e82-4609-aa43-9b5d6a712a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.263824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6ede4fdc-e788-421e-b362-5214fce46513 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:55.271653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6ede4fdc-e788-421e-b362-5214fce46513 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.351131 Jul 27 20:15:55.272289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 170/344] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:54 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:55.274246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b055afc1-9e82-4609-aa43-9b5d6a712a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.191402 Jul 27 20:15:55.275536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 175/345] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Jul 27 20:15:55 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:15:55.291011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f8e8afa0-5ab0-440c-8b29-fb77c8465e0f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:55.291629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f8e8afa0-5ab0-440c-8b29-fb77c8465e0f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:55.297684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8e8afa0-5ab0-440c-8b29-fb77c8465e0f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.298078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8e8afa0-5ab0-440c-8b29-fb77c8465e0f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.298844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8e8afa0-5ab0-440c-8b29-fb77c8465e0f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.299277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8e8afa0-5ab0-440c-8b29-fb77c8465e0f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.484710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f8e8afa0-5ab0-440c-8b29-fb77c8465e0f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:55.493896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f8e8afa0-5ab0-440c-8b29-fb77c8465e0f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1509 microversion: 2.1 time: 0.208081 Jul 27 20:15:55.494772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 171/346] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:55 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:55.514097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-db61dcbb-1b6e-426a-b58d-757b4779ffdf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:55.520437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db61dcbb-1b6e-426a-b58d-757b4779ffdf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.521045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db61dcbb-1b6e-426a-b58d-757b4779ffdf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.582039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-db61dcbb-1b6e-426a-b58d-757b4779ffdf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Going to try to stop instance {{(pid=118273) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 27 20:15:55.810680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-db61dcbb-1b6e-426a-b58d-757b4779ffdf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "POST /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/action" status: 202 len: 0 microversion: 2.1 time: 0.300221 Jul 27 20:15:55.811337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 176/347] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:15:55 2022] POST /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:15:55.819387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8cc03089-56da-4f3e-820b-54b802b1f441 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:55.820612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8cc03089-56da-4f3e-820b-54b802b1f441 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:55.826556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cc03089-56da-4f3e-820b-54b802b1f441 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.827007 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cc03089-56da-4f3e-820b-54b802b1f441 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.827771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cc03089-56da-4f3e-820b-54b802b1f441 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.828207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cc03089-56da-4f3e-820b-54b802b1f441 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.960303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8cc03089-56da-4f3e-820b-54b802b1f441 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:55.970189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8cc03089-56da-4f3e-820b-54b802b1f441 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.154579 Jul 27 20:15:55.973255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 172/348] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:55 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:56.297768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-79a00d87-004f-4558-86c0-a5471b8938fd tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:56.298537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-79a00d87-004f-4558-86c0-a5471b8938fd tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:56.306861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79a00d87-004f-4558-86c0-a5471b8938fd tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:56.307570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79a00d87-004f-4558-86c0-a5471b8938fd tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:56.308410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79a00d87-004f-4558-86c0-a5471b8938fd tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:56.308860 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79a00d87-004f-4558-86c0-a5471b8938fd tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:56.457599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-79a00d87-004f-4558-86c0-a5471b8938fd tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:56.466575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-79a00d87-004f-4558-86c0-a5471b8938fd tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.173115 Jul 27 20:15:56.473165 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 177/349] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:56 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:56.516121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c3b1747b-e3f7-4e78-9193-bd7b1f0e23b3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:56.517039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c3b1747b-e3f7-4e78-9193-bd7b1f0e23b3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:56.523476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3b1747b-e3f7-4e78-9193-bd7b1f0e23b3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:56.523998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3b1747b-e3f7-4e78-9193-bd7b1f0e23b3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:56.524847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3b1747b-e3f7-4e78-9193-bd7b1f0e23b3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:56.525443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3b1747b-e3f7-4e78-9193-bd7b1f0e23b3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:56.660213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c3b1747b-e3f7-4e78-9193-bd7b1f0e23b3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:56.668506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c3b1747b-e3f7-4e78-9193-bd7b1f0e23b3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1509 microversion: 2.1 time: 0.156455 Jul 27 20:15:56.669092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 173/350] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:56 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:56.774970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-1e212fa8-2131-4714-96cf-1f5b8c1da28a req-071f45ca-38be-4861-9404-e09b729f85ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0929536d-2d91-4e59-8f36-474025d921ef", "tag": "39cce058-68c6-4a18-8354-201c5dba75c7"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:56.784800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-1e212fa8-2131-4714-96cf-1f5b8c1da28a req-071f45ca-38be-4861-9404-e09b729f85ad service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:56.785244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-1e212fa8-2131-4714-96cf-1f5b8c1da28a req-071f45ca-38be-4861-9404-e09b729f85ad service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:56.796581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-1e212fa8-2131-4714-96cf-1f5b8c1da28a req-071f45ca-38be-4861-9404-e09b729f85ad service nova] Creating event network-changed:39cce058-68c6-4a18-8354-201c5dba75c7 for instance 0929536d-2d91-4e59-8f36-474025d921ef on hv-cinder-85124 Jul 27 20:15:56.801477 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-1e212fa8-2131-4714-96cf-1f5b8c1da28a req-071f45ca-38be-4861-9404-e09b729f85ad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030604 Jul 27 20:15:56.802069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 178/351] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:56.993425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d52b28cb-8a2c-4e43-b4b8-7956a9a4a22f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:56.994036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d52b28cb-8a2c-4e43-b4b8-7956a9a4a22f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:57.000618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d52b28cb-8a2c-4e43-b4b8-7956a9a4a22f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:57.001072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d52b28cb-8a2c-4e43-b4b8-7956a9a4a22f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:57.001905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d52b28cb-8a2c-4e43-b4b8-7956a9a4a22f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:57.002270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d52b28cb-8a2c-4e43-b4b8-7956a9a4a22f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:57.179126 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d52b28cb-8a2c-4e43-b4b8-7956a9a4a22f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:57.187245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d52b28cb-8a2c-4e43-b4b8-7956a9a4a22f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.197959 Jul 27 20:15:57.187855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 174/352] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:56 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:57.489282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5467ad3f-fcce-41a9-86f9-106abae71df3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:57.490536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5467ad3f-fcce-41a9-86f9-106abae71df3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:57.497158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5467ad3f-fcce-41a9-86f9-106abae71df3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:57.498236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5467ad3f-fcce-41a9-86f9-106abae71df3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:57.499050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5467ad3f-fcce-41a9-86f9-106abae71df3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:57.499503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5467ad3f-fcce-41a9-86f9-106abae71df3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:57.654585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5467ad3f-fcce-41a9-86f9-106abae71df3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:57.662496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5467ad3f-fcce-41a9-86f9-106abae71df3 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1315 microversion: 2.1 time: 0.177235 Jul 27 20:15:57.663077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 179/353] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:57 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:57.695420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6654d182-5330-4672-b11d-567f3ac5d778 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:57.696026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6654d182-5330-4672-b11d-567f3ac5d778 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:57.702403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6654d182-5330-4672-b11d-567f3ac5d778 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:57.702841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6654d182-5330-4672-b11d-567f3ac5d778 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:57.703691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6654d182-5330-4672-b11d-567f3ac5d778 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:57.704263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6654d182-5330-4672-b11d-567f3ac5d778 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:57.724732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:57.855662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6654d182-5330-4672-b11d-567f3ac5d778 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:57.864666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6654d182-5330-4672-b11d-567f3ac5d778 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1509 microversion: 2.1 time: 0.173010 Jul 27 20:15:57.865327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 175/354] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:57 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:58.211200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bb208486-9322-4c88-afb3-87f3d140867d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:58.211900 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bb208486-9322-4c88-afb3-87f3d140867d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:58.214509 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:58.219273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb208486-9322-4c88-afb3-87f3d140867d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.219724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb208486-9322-4c88-afb3-87f3d140867d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.220516 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb208486-9322-4c88-afb3-87f3d140867d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.220955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb208486-9322-4c88-afb3-87f3d140867d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.236408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:58.392356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bb208486-9322-4c88-afb3-87f3d140867d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:58.400810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bb208486-9322-4c88-afb3-87f3d140867d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.193939 Jul 27 20:15:58.404500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 180/355] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:58 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:58.683636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-46cbf692-116b-4d48-8828-c602e1a1b036 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:58.684387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-46cbf692-116b-4d48-8828-c602e1a1b036 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:58.690671 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46cbf692-116b-4d48-8828-c602e1a1b036 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.691123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46cbf692-116b-4d48-8828-c602e1a1b036 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.691888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46cbf692-116b-4d48-8828-c602e1a1b036 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.692522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46cbf692-116b-4d48-8828-c602e1a1b036 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.840200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-46cbf692-116b-4d48-8828-c602e1a1b036 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:58.848132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-46cbf692-116b-4d48-8828-c602e1a1b036 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1465 microversion: 2.1 time: 0.168396 Jul 27 20:15:58.848802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 176/356] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:58 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1465 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:58.889277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a49872b2-536c-421a-b5ee-4adfbe0727fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:58.889277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a49872b2-536c-421a-b5ee-4adfbe0727fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:58.900707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b66576f4-c326-4167-b7de-931a3ddc443b tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:58.900844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a49872b2-536c-421a-b5ee-4adfbe0727fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.900844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a49872b2-536c-421a-b5ee-4adfbe0727fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.901069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a49872b2-536c-421a-b5ee-4adfbe0727fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.901633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b66576f4-c326-4167-b7de-931a3ddc443b tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:58.904933 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a49872b2-536c-421a-b5ee-4adfbe0727fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.911268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b66576f4-c326-4167-b7de-931a3ddc443b tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.911716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b66576f4-c326-4167-b7de-931a3ddc443b tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.912622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b66576f4-c326-4167-b7de-931a3ddc443b tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.913050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b66576f4-c326-4167-b7de-931a3ddc443b tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.939522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b66576f4-c326-4167-b7de-931a3ddc443b tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:15:59.047496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a49872b2-536c-421a-b5ee-4adfbe0727fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:59.055367 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a49872b2-536c-421a-b5ee-4adfbe0727fd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1515 microversion: 2.1 time: 0.173205 Jul 27 20:15:59.055935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 181/357] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:58 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:59.265042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b66576f4-c326-4167-b7de-931a3ddc443b tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "DELETE /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 204 len: 0 microversion: 2.1 time: 0.371097 Jul 27 20:15:59.265773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 177/358] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:15:58 2022] DELETE /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:15:59.277046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9ba74cb3-f855-4ae1-8f36-6cc34654a790 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:59.277656 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9ba74cb3-f855-4ae1-8f36-6cc34654a790 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:59.284294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ba74cb3-f855-4ae1-8f36-6cc34654a790 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:59.284783 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ba74cb3-f855-4ae1-8f36-6cc34654a790 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:59.285583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ba74cb3-f855-4ae1-8f36-6cc34654a790 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:59.286020 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ba74cb3-f855-4ae1-8f36-6cc34654a790 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:59.422756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e145a3ee-12cc-4c45-b3a1-86a95def0ea4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:59.423488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e145a3ee-12cc-4c45-b3a1-86a95def0ea4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:59.430303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e145a3ee-12cc-4c45-b3a1-86a95def0ea4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:59.430904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9ba74cb3-f855-4ae1-8f36-6cc34654a790 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:59.431135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e145a3ee-12cc-4c45-b3a1-86a95def0ea4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:59.432084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e145a3ee-12cc-4c45-b3a1-86a95def0ea4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:59.432711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e145a3ee-12cc-4c45-b3a1-86a95def0ea4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:59.441542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9ba74cb3-f855-4ae1-8f36-6cc34654a790 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1471 microversion: 2.1 time: 0.169137 Jul 27 20:15:59.442138 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 182/359] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:59 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:59.616475 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e145a3ee-12cc-4c45-b3a1-86a95def0ea4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:59.625562 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e145a3ee-12cc-4c45-b3a1-86a95def0ea4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.207402 Jul 27 20:15:59.626410 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 178/360] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:59 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:00.463262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-99fd3071-ca45-4899-a2de-55247ae661ce tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:00.463876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-99fd3071-ca45-4899-a2de-55247ae661ce tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:00.470715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99fd3071-ca45-4899-a2de-55247ae661ce tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:00.471222 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99fd3071-ca45-4899-a2de-55247ae661ce tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:00.471977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99fd3071-ca45-4899-a2de-55247ae661ce tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:00.472439 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99fd3071-ca45-4899-a2de-55247ae661ce tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:00.602382 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-99fd3071-ca45-4899-a2de-55247ae661ce tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:00.609842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-99fd3071-ca45-4899-a2de-55247ae661ce tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1471 microversion: 2.1 time: 0.150666 Jul 27 20:16:00.610430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 183/361] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:00 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:00.646849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b10a7b44-3b0c-4608-b1cc-1398f522b37f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:00.647454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b10a7b44-3b0c-4608-b1cc-1398f522b37f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:00.649992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:00.654694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b10a7b44-3b0c-4608-b1cc-1398f522b37f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:00.658905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b10a7b44-3b0c-4608-b1cc-1398f522b37f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:00.658905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b10a7b44-3b0c-4608-b1cc-1398f522b37f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:00.658905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b10a7b44-3b0c-4608-b1cc-1398f522b37f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:00.790256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b10a7b44-3b0c-4608-b1cc-1398f522b37f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:00.798068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b10a7b44-3b0c-4608-b1cc-1398f522b37f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.155003 Jul 27 20:16:00.798637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 179/362] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:00 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:00.823119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5bc14a8b-58f5-4aa4-8685-25dd60b73f40 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Action: 'create', calling method: .version_select at 0x7f35cad8f040>, body: {"keypair": {"name": "tempest-keypair-555757349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw+vaWGlFcNMadPP4jQEpFubhBDGJmrGV2a1lqAAbS7T+GXsUccQNmPTCBSymY/AZSH1CYidSe+RgFVDBkz3iZbv+u1LYet6kR/YdofUxkUOo8jTW54ka5I/unCTXrHxw=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:00.839658 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-5bc14a8b-58f5-4aa4-8685-25dd60b73f40 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Getting quotas for project 2ff46475bc95496f93ad4ac4459d7cc5. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:16:00.843608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-5bc14a8b-58f5-4aa4-8685-25dd60b73f40 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Getting quotas for user 77b0df6c83a84dbcb0fa5802c93dc6ae and project 2ff46475bc95496f93ad4ac4459d7cc5. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:16:00.940551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5bc14a8b-58f5-4aa4-8685-25dd60b73f40 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121156 Jul 27 20:16:00.941149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 184/363] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:16:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:01.631163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ea097189-697a-4a9f-a6df-f68a763a3789 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:01.631776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ea097189-697a-4a9f-a6df-f68a763a3789 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:01.638468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea097189-697a-4a9f-a6df-f68a763a3789 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:01.638918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea097189-697a-4a9f-a6df-f68a763a3789 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:01.639672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea097189-697a-4a9f-a6df-f68a763a3789 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:01.640239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea097189-697a-4a9f-a6df-f68a763a3789 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:01.776562 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ea097189-697a-4a9f-a6df-f68a763a3789 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:01.785209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ea097189-697a-4a9f-a6df-f68a763a3789 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1471 microversion: 2.1 time: 0.157931 Jul 27 20:16:01.794145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 180/364] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:01 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:01.819026 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-70fef0ac-2969-4aca-b9a0-c283ca012661 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:01.819651 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-70fef0ac-2969-4aca-b9a0-c283ca012661 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:01.826620 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70fef0ac-2969-4aca-b9a0-c283ca012661 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:01.827065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70fef0ac-2969-4aca-b9a0-c283ca012661 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:01.827834 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70fef0ac-2969-4aca-b9a0-c283ca012661 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:01.828280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70fef0ac-2969-4aca-b9a0-c283ca012661 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:02.044181 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-70fef0ac-2969-4aca-b9a0-c283ca012661 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:02.052347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-70fef0ac-2969-4aca-b9a0-c283ca012661 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.237176 Jul 27 20:16:02.053159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 185/365] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:01 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:02.807375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-077ce6d5-cff9-47c3-bd88-49fdadcf9e22 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:02.808639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-077ce6d5-cff9-47c3-bd88-49fdadcf9e22 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:02.817049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-077ce6d5-cff9-47c3-bd88-49fdadcf9e22 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:02.817487 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-077ce6d5-cff9-47c3-bd88-49fdadcf9e22 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:02.818250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-077ce6d5-cff9-47c3-bd88-49fdadcf9e22 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:02.818852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-077ce6d5-cff9-47c3-bd88-49fdadcf9e22 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:02.978110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-077ce6d5-cff9-47c3-bd88-49fdadcf9e22 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:02.985613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-077ce6d5-cff9-47c3-bd88-49fdadcf9e22 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1471 microversion: 2.1 time: 0.182696 Jul 27 20:16:02.986164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 181/366] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:02 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:03.074512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d2433475-4d55-424d-8086-917ac796ed9e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:03.075060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d2433475-4d55-424d-8086-917ac796ed9e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:03.081769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2433475-4d55-424d-8086-917ac796ed9e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:03.082279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2433475-4d55-424d-8086-917ac796ed9e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:03.083187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2433475-4d55-424d-8086-917ac796ed9e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:03.083692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2433475-4d55-424d-8086-917ac796ed9e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:03.222205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d2433475-4d55-424d-8086-917ac796ed9e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:03.230413 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d2433475-4d55-424d-8086-917ac796ed9e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.160601 Jul 27 20:16:03.230981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 186/367] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:03 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:03.324496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-146487264", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94b1e3de-e2f1-41f2-b682-e11d443875aa"}], "security_groups": [{"name": "tempest-securitygroup--1145255732"}], "key_name": "tempest-keypair-555757349", "user_data": "}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:03.599012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] validate_networks() for [('94b1e3de-e2f1-41f2-b682-e11d443875aa', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:16:04.007455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be06d937-42f2-44b5-8c81-26709c355f1d tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:04.008116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-be06d937-42f2-44b5-8c81-26709c355f1d tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:04.015502 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be06d937-42f2-44b5-8c81-26709c355f1d tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:04.015972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be06d937-42f2-44b5-8c81-26709c355f1d tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:04.016871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be06d937-42f2-44b5-8c81-26709c355f1d tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:04.017306 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be06d937-42f2-44b5-8c81-26709c355f1d tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:04.117239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-be06d937-42f2-44b5-8c81-26709c355f1d tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:04.127036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-be06d937-42f2-44b5-8c81-26709c355f1d tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1429 microversion: 2.1 time: 0.123708 Jul 27 20:16:04.127937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 187/368] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:04 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:04.167746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-26aa5ff8-3b4b-4d9a-8bbe-6bd9c5024dbe req-c4467775-518f-4ff4-887b-02b97b50e9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736967d7-db62-4dcb-9a61-83fb767d6179", "name": "network-vif-deleted", "tag": "32b0ae84-ead4-4da7-8300-e17221984e66"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:04.178225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-26aa5ff8-3b4b-4d9a-8bbe-6bd9c5024dbe req-c4467775-518f-4ff4-887b-02b97b50e9c4 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:04.178977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-26aa5ff8-3b4b-4d9a-8bbe-6bd9c5024dbe req-c4467775-518f-4ff4-887b-02b97b50e9c4 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:04.193699 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-26aa5ff8-3b4b-4d9a-8bbe-6bd9c5024dbe req-c4467775-518f-4ff4-887b-02b97b50e9c4 service nova] Creating event network-vif-deleted:32b0ae84-ead4-4da7-8300-e17221984e66 for instance 736967d7-db62-4dcb-9a61-83fb767d6179 on hv-cinder-85124 Jul 27 20:16:04.199922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-26aa5ff8-3b4b-4d9a-8bbe-6bd9c5024dbe req-c4467775-518f-4ff4-887b-02b97b50e9c4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035468 Jul 27 20:16:04.199922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 188/369] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:04.249183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:16:04.249666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:16:04.250078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:16:04.250485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:16:04.251063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:16:04.253943 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a24b3e2f-1c97-4e42-b539-ec06a11d1f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:04.255584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a24b3e2f-1c97-4e42-b539-ec06a11d1f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:04.260754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:04.261205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:04.261764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a24b3e2f-1c97-4e42-b539-ec06a11d1f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:04.262004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:04.262219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a24b3e2f-1c97-4e42-b539-ec06a11d1f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:04.262439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:04.262982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a24b3e2f-1c97-4e42-b539-ec06a11d1f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:04.263421 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a24b3e2f-1c97-4e42-b539-ec06a11d1f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:04.280293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Getting quotas for project 2ff46475bc95496f93ad4ac4459d7cc5. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:16:04.284351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Getting quotas for user 77b0df6c83a84dbcb0fa5802c93dc6ae and project 2ff46475bc95496f93ad4ac4459d7cc5. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:16:04.295533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:16:04.297834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:16:04.441586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-31ab0d85-fa8f-4db4-a421-c7b31f0e7f6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.123557 Jul 27 20:16:04.442231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 182/370] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:16:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:16:04.455690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bb3fc379-c1b4-4e6b-833a-e29c4852066f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:04.456336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bb3fc379-c1b4-4e6b-833a-e29c4852066f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:04.613267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bb3fc379-c1b4-4e6b-833a-e29c4852066f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:04.625664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bb3fc379-c1b4-4e6b-833a-e29c4852066f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1244 microversion: 2.1 time: 0.175111 Jul 27 20:16:04.626384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 183/371] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:04 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1244 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:04.699526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a24b3e2f-1c97-4e42-b539-ec06a11d1f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:04.708996 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a24b3e2f-1c97-4e42-b539-ec06a11d1f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.459461 Jul 27 20:16:04.709581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 189/372] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:04 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:05.149432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:05.150033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:05.156657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.157427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.158873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.159352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.194893 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.195340 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.195780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lazy-loading 'fault' on Instance uuid 736967d7-db62-4dcb-9a61-83fb767d6179 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:16:05.237253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412828a7f19c451a9784f370f84c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ac8b4f98e45f5940e643b3afa6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:05.245005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bba2d1d8-1200-4213-9ea4-282b6d2a05b1 tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 200 len: 1305 microversion: 2.1 time: 0.100640 Jul 27 20:16:05.245568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 184/373] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:05 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:05.646861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cd134201-cae1-49c9-8c63-ead8ec37d4f4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:05.647406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cd134201-cae1-49c9-8c63-ead8ec37d4f4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:05.653897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd134201-cae1-49c9-8c63-ead8ec37d4f4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.654348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd134201-cae1-49c9-8c63-ead8ec37d4f4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.655108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd134201-cae1-49c9-8c63-ead8ec37d4f4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.655598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd134201-cae1-49c9-8c63-ead8ec37d4f4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.722128 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd134201-cae1-49c9-8c63-ead8ec37d4f4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:05.730338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cd134201-cae1-49c9-8c63-ead8ec37d4f4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1248 microversion: 2.1 time: 0.087364 Jul 27 20:16:05.731389 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 190/374] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:05 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:05.732659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-452a23b4-eae0-4e4e-b077-9b2f08a75aae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:05.733422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-452a23b4-eae0-4e4e-b077-9b2f08a75aae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:05.739946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-452a23b4-eae0-4e4e-b077-9b2f08a75aae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.740790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-452a23b4-eae0-4e4e-b077-9b2f08a75aae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.741199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-452a23b4-eae0-4e4e-b077-9b2f08a75aae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.741639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-452a23b4-eae0-4e4e-b077-9b2f08a75aae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.870667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-452a23b4-eae0-4e4e-b077-9b2f08a75aae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:05.878595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-452a23b4-eae0-4e4e-b077-9b2f08a75aae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.152342 Jul 27 20:16:05.879171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 185/375] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:05 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:06.266562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:06.267195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] [instance: 736967d7-db62-4dcb-9a61-83fb767d6179] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:06.273233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.274192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:06.274951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.275382 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:06.288810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] HTTP exception thrown: Instance 736967d7-db62-4dcb-9a61-83fb767d6179 could not be found. Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Request method failure captured: Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 HTTP/1.1 Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZzfSL70k_wW5i0rd9Ha6P4k_l2OA2uE_WGpzYa63ze8FBAoiJBNYnT_kBckL7BjkHdvkU9kIoHHsW_c2vFTwSSqHogWkaEMHUlqZsQMmOw7c2-bYtvWf9anfDO4sAg1fNuhl5WDOnnA6yTY6gIOUqkTJuA_Q15IuT_WVoSNA1w7VCI Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 370ac8b4f98e45f5940e643b3afa6be3 Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesNegativeTest-1140682686 Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:16:06.290965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/370ac8b4f98e45f5940e643b3afa6be3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/370ac8b4f98e45f5940e643b3afa6be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/370ac8b4f98e45f5940e643b3afa6be3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_370ac8b4f98e45f5940e643b3afa6be3", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesNegativeTest-1140682686 Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 370ac8b4f98e45f5940e643b3afa6be3 Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesNegativeTest-1140682686 Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesNegativeTest-1140682686-project Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 412828a7f19c451a9784f370f84c37ec Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesNegativeTest-1140682686-project Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 736967d7-db62-4dcb-9a61-83fb767d6179 could not be found. Jul 27 20:16:06.292566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '736967d7-db62-4dcb-9a61-83fb767d6179'} Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 736967d7-db62-4dcb-9a61-83fb767d6179 could not be found. Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:16:06.293378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 736967d7-db62-4dcb-9a61-83fb767d6179 could not be found. Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 736967d7-db62-4dcb-9a61-83fb767d6179 could not be found. Jul 27 20:16:06.294645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:16:06.295889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] Returning 404 to user: Instance 736967d7-db62-4dcb-9a61-83fb767d6179 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:16:06.295889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-86613933-2247-4c88-880b-ee36f126dd9f tempest-VolumesNegativeTest-1140682686 tempest-VolumesNegativeTest-1140682686-project] 10.222.0.47 "GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179" status: 404 len: 111 microversion: 2.1 time: 0.029715 Jul 27 20:16:06.295889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 191/376] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:06 2022] GET /compute/v2.1/servers/736967d7-db62-4dcb-9a61-83fb767d6179 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:16:06.750812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8327aa15-f073-407b-bcdd-3ebd421eab7a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:06.751455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8327aa15-f073-407b-bcdd-3ebd421eab7a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:06.758663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8327aa15-f073-407b-bcdd-3ebd421eab7a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.764477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8327aa15-f073-407b-bcdd-3ebd421eab7a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:06.764477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8327aa15-f073-407b-bcdd-3ebd421eab7a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.764477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8327aa15-f073-407b-bcdd-3ebd421eab7a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:06.821642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8327aa15-f073-407b-bcdd-3ebd421eab7a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:06.829168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8327aa15-f073-407b-bcdd-3ebd421eab7a tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1240 microversion: 2.1 time: 0.082178 Jul 27 20:16:06.829731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 186/377] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:06 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:06.899185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-02a4fecd-29a2-40b4-9a6f-b2933316e6f3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:06.899792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-02a4fecd-29a2-40b4-9a6f-b2933316e6f3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:06.906335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02a4fecd-29a2-40b4-9a6f-b2933316e6f3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.906788 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02a4fecd-29a2-40b4-9a6f-b2933316e6f3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:06.907540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02a4fecd-29a2-40b4-9a6f-b2933316e6f3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.907974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02a4fecd-29a2-40b4-9a6f-b2933316e6f3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:07.038243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-02a4fecd-29a2-40b4-9a6f-b2933316e6f3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:07.046708 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-02a4fecd-29a2-40b4-9a6f-b2933316e6f3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.151563 Jul 27 20:16:07.047274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 192/378] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:06 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:07.849975 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1a65bb0a-a33f-49de-b0dc-4797bbab2217 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:07.850642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1a65bb0a-a33f-49de-b0dc-4797bbab2217 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:07.857243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a65bb0a-a33f-49de-b0dc-4797bbab2217 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:07.857708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a65bb0a-a33f-49de-b0dc-4797bbab2217 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:07.858473 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a65bb0a-a33f-49de-b0dc-4797bbab2217 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:07.858908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a65bb0a-a33f-49de-b0dc-4797bbab2217 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:07.919253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a65bb0a-a33f-49de-b0dc-4797bbab2217 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:07.926669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1a65bb0a-a33f-49de-b0dc-4797bbab2217 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1240 microversion: 2.1 time: 0.080576 Jul 27 20:16:07.927234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 187/379] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:07 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:08.067748 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cac48307-9da5-495b-8167-182f512197e8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:08.068363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cac48307-9da5-495b-8167-182f512197e8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:08.075291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cac48307-9da5-495b-8167-182f512197e8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:08.076323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cac48307-9da5-495b-8167-182f512197e8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:08.077118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cac48307-9da5-495b-8167-182f512197e8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:08.081556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cac48307-9da5-495b-8167-182f512197e8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:08.230147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cac48307-9da5-495b-8167-182f512197e8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:08.238086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cac48307-9da5-495b-8167-182f512197e8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.174242 Jul 27 20:16:08.238646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 193/380] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:08 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:08.946861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-12faeb71-8a8d-4d0c-a69f-50bdf50b0fe3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:08.947517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-12faeb71-8a8d-4d0c-a69f-50bdf50b0fe3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:08.954619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12faeb71-8a8d-4d0c-a69f-50bdf50b0fe3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:08.958641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12faeb71-8a8d-4d0c-a69f-50bdf50b0fe3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:08.958641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12faeb71-8a8d-4d0c-a69f-50bdf50b0fe3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:08.958641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12faeb71-8a8d-4d0c-a69f-50bdf50b0fe3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:09.022201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12faeb71-8a8d-4d0c-a69f-50bdf50b0fe3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:09.030429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-12faeb71-8a8d-4d0c-a69f-50bdf50b0fe3 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1296 microversion: 2.1 time: 0.087384 Jul 27 20:16:09.031133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 188/381] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:08 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:09.260969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-79901333-f750-4323-a84b-4aa962e0d811 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:09.263259 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-79901333-f750-4323-a84b-4aa962e0d811 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:09.268161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79901333-f750-4323-a84b-4aa962e0d811 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:09.268649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79901333-f750-4323-a84b-4aa962e0d811 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:09.274159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79901333-f750-4323-a84b-4aa962e0d811 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:09.274159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79901333-f750-4323-a84b-4aa962e0d811 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:09.415700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-79901333-f750-4323-a84b-4aa962e0d811 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:09.423715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-79901333-f750-4323-a84b-4aa962e0d811 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.167101 Jul 27 20:16:09.424299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 194/382] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:09 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:10.052497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b09a2a63-6d08-440c-b6ba-b852aac86d6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:10.057921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b09a2a63-6d08-440c-b6ba-b852aac86d6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:10.076371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b09a2a63-6d08-440c-b6ba-b852aac86d6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:10.076371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b09a2a63-6d08-440c-b6ba-b852aac86d6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:10.076611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b09a2a63-6d08-440c-b6ba-b852aac86d6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:10.077040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b09a2a63-6d08-440c-b6ba-b852aac86d6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:10.160412 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b09a2a63-6d08-440c-b6ba-b852aac86d6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:10.172314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b09a2a63-6d08-440c-b6ba-b852aac86d6f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1302 microversion: 2.1 time: 0.124088 Jul 27 20:16:10.173009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 189/383] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:10 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:10.451392 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d118b204-fddb-4bf0-abe2-0a80375bfbc9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:10.452014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d118b204-fddb-4bf0-abe2-0a80375bfbc9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:10.461625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d118b204-fddb-4bf0-abe2-0a80375bfbc9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:10.462084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d118b204-fddb-4bf0-abe2-0a80375bfbc9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:10.462858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d118b204-fddb-4bf0-abe2-0a80375bfbc9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:10.463298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d118b204-fddb-4bf0-abe2-0a80375bfbc9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:10.641761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d118b204-fddb-4bf0-abe2-0a80375bfbc9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:10.651297 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d118b204-fddb-4bf0-abe2-0a80375bfbc9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.203687 Jul 27 20:16:10.656602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 195/384] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:10 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:11.194494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-221a453d-0020-4427-aa42-20a1b4cbe054 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:11.195711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-221a453d-0020-4427-aa42-20a1b4cbe054 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:11.202276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-221a453d-0020-4427-aa42-20a1b4cbe054 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:11.202722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-221a453d-0020-4427-aa42-20a1b4cbe054 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:11.203476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-221a453d-0020-4427-aa42-20a1b4cbe054 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:11.203905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-221a453d-0020-4427-aa42-20a1b4cbe054 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:11.329318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-221a453d-0020-4427-aa42-20a1b4cbe054 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:11.336846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-221a453d-0020-4427-aa42-20a1b4cbe054 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.146202 Jul 27 20:16:11.337772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 190/385] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:11 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:11.672964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3cf8d4bd-088d-4ead-be8f-e0981f7b0a3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:11.673586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3cf8d4bd-088d-4ead-be8f-e0981f7b0a3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:11.676583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:11.681407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cf8d4bd-088d-4ead-be8f-e0981f7b0a3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:11.681883 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cf8d4bd-088d-4ead-be8f-e0981f7b0a3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:11.682650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cf8d4bd-088d-4ead-be8f-e0981f7b0a3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:11.683091 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cf8d4bd-088d-4ead-be8f-e0981f7b0a3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:11.816494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3cf8d4bd-088d-4ead-be8f-e0981f7b0a3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:11.824618 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3cf8d4bd-088d-4ead-be8f-e0981f7b0a3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.155356 Jul 27 20:16:11.825182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 196/386] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:11 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:12.357810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2bf8ff93-37d0-48cf-8fe8-13376b2dfc04 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:12.358425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2bf8ff93-37d0-48cf-8fe8-13376b2dfc04 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:12.364905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bf8ff93-37d0-48cf-8fe8-13376b2dfc04 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:12.365356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bf8ff93-37d0-48cf-8fe8-13376b2dfc04 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:12.366115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bf8ff93-37d0-48cf-8fe8-13376b2dfc04 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:12.366548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bf8ff93-37d0-48cf-8fe8-13376b2dfc04 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:12.494475 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2bf8ff93-37d0-48cf-8fe8-13376b2dfc04 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:12.497884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:12.502132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2bf8ff93-37d0-48cf-8fe8-13376b2dfc04 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.148229 Jul 27 20:16:12.502700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 191/387] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:12 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:12.845302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-55184ae8-a26e-429d-af96-a6b8c5cf20e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:12.845920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-55184ae8-a26e-429d-af96-a6b8c5cf20e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:12.852468 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-55184ae8-a26e-429d-af96-a6b8c5cf20e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:12.853812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-55184ae8-a26e-429d-af96-a6b8c5cf20e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:12.854574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-55184ae8-a26e-429d-af96-a6b8c5cf20e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:12.855009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-55184ae8-a26e-429d-af96-a6b8c5cf20e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:13.020452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-55184ae8-a26e-429d-af96-a6b8c5cf20e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:13.029205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-55184ae8-a26e-429d-af96-a6b8c5cf20e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.187664 Jul 27 20:16:13.029973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 197/388] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:12 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:13.523964 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a7277f7b-d08e-4001-bd43-28b4a22068aa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:13.525165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a7277f7b-d08e-4001-bd43-28b4a22068aa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:13.533292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7277f7b-d08e-4001-bd43-28b4a22068aa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:13.533741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7277f7b-d08e-4001-bd43-28b4a22068aa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:13.534512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7277f7b-d08e-4001-bd43-28b4a22068aa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:13.534950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7277f7b-d08e-4001-bd43-28b4a22068aa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:13.671880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-15ce7623-4e40-421a-97a3-6426b1a848a7 req-81ede82a-5f01-4aec-95d9-cecc4dc873ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541f66f3-1a9d-4587-8012-c5636c1cd2ce", "tag": "60ef2664-40a6-420e-85c7-230bee398552"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:13.682306 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-15ce7623-4e40-421a-97a3-6426b1a848a7 req-81ede82a-5f01-4aec-95d9-cecc4dc873ee service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:13.682757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-15ce7623-4e40-421a-97a3-6426b1a848a7 req-81ede82a-5f01-4aec-95d9-cecc4dc873ee service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:13.694485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-15ce7623-4e40-421a-97a3-6426b1a848a7 req-81ede82a-5f01-4aec-95d9-cecc4dc873ee service nova] Creating event network-changed:60ef2664-40a6-420e-85c7-230bee398552 for instance 541f66f3-1a9d-4587-8012-c5636c1cd2ce on hv-cinder-85124 Jul 27 20:16:13.701071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-15ce7623-4e40-421a-97a3-6426b1a848a7 req-81ede82a-5f01-4aec-95d9-cecc4dc873ee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032696 Jul 27 20:16:13.701789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 198/389] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:13.750114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a7277f7b-d08e-4001-bd43-28b4a22068aa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:13.762889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a7277f7b-d08e-4001-bd43-28b4a22068aa tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.243646 Jul 27 20:16:13.763458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 192/390] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:13 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:14.051605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f322e2b5-2083-42f6-9cd1-48d30d1a357d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:14.057369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f322e2b5-2083-42f6-9cd1-48d30d1a357d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:14.064268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f322e2b5-2083-42f6-9cd1-48d30d1a357d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:14.064747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f322e2b5-2083-42f6-9cd1-48d30d1a357d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:14.065518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f322e2b5-2083-42f6-9cd1-48d30d1a357d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:14.066000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f322e2b5-2083-42f6-9cd1-48d30d1a357d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:14.205976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f322e2b5-2083-42f6-9cd1-48d30d1a357d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:14.211162 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f322e2b5-2083-42f6-9cd1-48d30d1a357d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.164702 Jul 27 20:16:14.211720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 199/391] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:14 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:14.783169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-58ad7be1-8603-4669-b365-94d448b992ea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:14.783766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-58ad7be1-8603-4669-b365-94d448b992ea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:14.785712 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:14.786871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=8 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:14.792500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58ad7be1-8603-4669-b365-94d448b992ea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:14.792942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58ad7be1-8603-4669-b365-94d448b992ea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:14.795264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58ad7be1-8603-4669-b365-94d448b992ea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:14.795264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58ad7be1-8603-4669-b365-94d448b992ea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:14.926275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-58ad7be1-8603-4669-b365-94d448b992ea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:14.933596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-58ad7be1-8603-4669-b365-94d448b992ea tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.154475 Jul 27 20:16:14.934161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 193/392] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:14 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:15.232720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9ed97b44-00ec-4660-9a6d-4b63e2c13eba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:15.233409 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9ed97b44-00ec-4660-9a6d-4b63e2c13eba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:15.240022 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ed97b44-00ec-4660-9a6d-4b63e2c13eba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:15.240526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ed97b44-00ec-4660-9a6d-4b63e2c13eba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:15.241324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ed97b44-00ec-4660-9a6d-4b63e2c13eba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:15.241769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ed97b44-00ec-4660-9a6d-4b63e2c13eba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:15.247160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:15.382815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9ed97b44-00ec-4660-9a6d-4b63e2c13eba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:15.391323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9ed97b44-00ec-4660-9a6d-4b63e2c13eba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.162483 Jul 27 20:16:15.391927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 200/393] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:15 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:15.954086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-12af764e-ea85-42d5-8f32-879ba515da73 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:15.954586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-12af764e-ea85-42d5-8f32-879ba515da73 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:15.961081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12af764e-ea85-42d5-8f32-879ba515da73 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:15.961523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12af764e-ea85-42d5-8f32-879ba515da73 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:15.962837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12af764e-ea85-42d5-8f32-879ba515da73 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:15.963263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12af764e-ea85-42d5-8f32-879ba515da73 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:16.092534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12af764e-ea85-42d5-8f32-879ba515da73 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:16.099848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-12af764e-ea85-42d5-8f32-879ba515da73 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.149675 Jul 27 20:16:16.100667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 194/394] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:15 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:16.411531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7a32e205-6169-4085-9dfd-bfe7a34d36f2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:16.412140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7a32e205-6169-4085-9dfd-bfe7a34d36f2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:16.419244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a32e205-6169-4085-9dfd-bfe7a34d36f2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:16.419685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a32e205-6169-4085-9dfd-bfe7a34d36f2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:16.420453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a32e205-6169-4085-9dfd-bfe7a34d36f2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:16.420884 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a32e205-6169-4085-9dfd-bfe7a34d36f2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:16.570375 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7a32e205-6169-4085-9dfd-bfe7a34d36f2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:16.579177 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7a32e205-6169-4085-9dfd-bfe7a34d36f2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.171503 Jul 27 20:16:16.579747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 201/395] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:16 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:17.120798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d35080f3-7bcb-4e82-a315-dfc0624dc30c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:17.122841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d35080f3-7bcb-4e82-a315-dfc0624dc30c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:17.127532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d35080f3-7bcb-4e82-a315-dfc0624dc30c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:17.127979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d35080f3-7bcb-4e82-a315-dfc0624dc30c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:17.128769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d35080f3-7bcb-4e82-a315-dfc0624dc30c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:17.129202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d35080f3-7bcb-4e82-a315-dfc0624dc30c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:17.258142 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d35080f3-7bcb-4e82-a315-dfc0624dc30c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:17.265702 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d35080f3-7bcb-4e82-a315-dfc0624dc30c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.149733 Jul 27 20:16:17.266285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 195/396] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:17 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:17.600055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-70733338-21aa-46f7-8a52-64e3771414a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:17.600683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-70733338-21aa-46f7-8a52-64e3771414a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:17.607244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70733338-21aa-46f7-8a52-64e3771414a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:17.607741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70733338-21aa-46f7-8a52-64e3771414a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:17.608517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70733338-21aa-46f7-8a52-64e3771414a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:17.608946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70733338-21aa-46f7-8a52-64e3771414a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:17.738590 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-70733338-21aa-46f7-8a52-64e3771414a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:17.746962 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-70733338-21aa-46f7-8a52-64e3771414a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.150814 Jul 27 20:16:17.747528 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 202/397] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:17 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:18.286825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fcc3d19b-3027-4fe8-bf68-ef1d43102352 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:18.287432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fcc3d19b-3027-4fe8-bf68-ef1d43102352 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:18.294463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fcc3d19b-3027-4fe8-bf68-ef1d43102352 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:18.294912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fcc3d19b-3027-4fe8-bf68-ef1d43102352 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:18.295663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fcc3d19b-3027-4fe8-bf68-ef1d43102352 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:18.296097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fcc3d19b-3027-4fe8-bf68-ef1d43102352 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:18.422959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fcc3d19b-3027-4fe8-bf68-ef1d43102352 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:18.431058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fcc3d19b-3027-4fe8-bf68-ef1d43102352 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.147644 Jul 27 20:16:18.431671 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 196/398] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:18 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:18.768227 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1979b7b3-69f6-4f8f-b2d5-a77b668da331 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:18.768879 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1979b7b3-69f6-4f8f-b2d5-a77b668da331 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:18.775867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1979b7b3-69f6-4f8f-b2d5-a77b668da331 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:18.776315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1979b7b3-69f6-4f8f-b2d5-a77b668da331 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:18.777102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1979b7b3-69f6-4f8f-b2d5-a77b668da331 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:18.777536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1979b7b3-69f6-4f8f-b2d5-a77b668da331 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:18.907472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1979b7b3-69f6-4f8f-b2d5-a77b668da331 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:18.916309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1979b7b3-69f6-4f8f-b2d5-a77b668da331 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.151889 Jul 27 20:16:18.916903 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 203/399] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:18 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:19.450956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f4b5304a-9d74-4624-bde5-3ad276a91ac1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:19.451565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f4b5304a-9d74-4624-bde5-3ad276a91ac1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:19.466017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4b5304a-9d74-4624-bde5-3ad276a91ac1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:19.466017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4b5304a-9d74-4624-bde5-3ad276a91ac1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:19.466017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4b5304a-9d74-4624-bde5-3ad276a91ac1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:19.466017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4b5304a-9d74-4624-bde5-3ad276a91ac1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:19.590967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f4b5304a-9d74-4624-bde5-3ad276a91ac1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:19.598342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f4b5304a-9d74-4624-bde5-3ad276a91ac1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.151109 Jul 27 20:16:19.598849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 197/400] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:19 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:19.937565 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3adb1227-c24d-4542-a627-82b966331255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:19.938095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3adb1227-c24d-4542-a627-82b966331255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:19.944360 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3adb1227-c24d-4542-a627-82b966331255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:19.944838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3adb1227-c24d-4542-a627-82b966331255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:19.945596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3adb1227-c24d-4542-a627-82b966331255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:19.946029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3adb1227-c24d-4542-a627-82b966331255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:20.153272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3adb1227-c24d-4542-a627-82b966331255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:20.162007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3adb1227-c24d-4542-a627-82b966331255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1723 microversion: 2.1 time: 0.228173 Jul 27 20:16:20.162594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 204/401] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:19 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:20.619123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c9375c7e-3a73-4f95-9399-15b6b6e5b47f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:20.619739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c9375c7e-3a73-4f95-9399-15b6b6e5b47f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:20.626205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9375c7e-3a73-4f95-9399-15b6b6e5b47f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:20.626654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9375c7e-3a73-4f95-9399-15b6b6e5b47f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:20.627413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9375c7e-3a73-4f95-9399-15b6b6e5b47f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:20.627844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9375c7e-3a73-4f95-9399-15b6b6e5b47f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:20.761883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c9375c7e-3a73-4f95-9399-15b6b6e5b47f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:20.769220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c9375c7e-3a73-4f95-9399-15b6b6e5b47f tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.154318 Jul 27 20:16:20.770643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 198/402] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:20 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:21.184512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-340abf7e-d875-42d5-9a4d-791cc468d685 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:21.185131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-340abf7e-d875-42d5-9a4d-791cc468d685 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:21.191536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-340abf7e-d875-42d5-9a4d-791cc468d685 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.191990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-340abf7e-d875-42d5-9a4d-791cc468d685 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.192785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-340abf7e-d875-42d5-9a4d-791cc468d685 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.193255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-340abf7e-d875-42d5-9a4d-791cc468d685 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.327647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-340abf7e-d875-42d5-9a4d-791cc468d685 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:21.337701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-340abf7e-d875-42d5-9a4d-791cc468d685 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1700 microversion: 2.1 time: 0.157556 Jul 27 20:16:21.338952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 205/403] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:21 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:21.361421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-75ea57e0-3402-4b25-bfee-58352a69a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:21.368591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-75ea57e0-3402-4b25-bfee-58352a69a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.369046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-75ea57e0-3402-4b25-bfee-58352a69a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.437818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-75ea57e0-3402-4b25-bfee-58352a69a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Going to try to start instance {{(pid=118274) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 27 20:16:21.776294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-75ea57e0-3402-4b25-bfee-58352a69a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "POST /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/action" status: 202 len: 0 microversion: 2.1 time: 0.418597 Jul 27 20:16:21.777347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 199/404] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:16:21 2022] POST /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:16:21.785979 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a4ebc725-49bb-4ebd-821e-c04afdf1c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:21.786601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a4ebc725-49bb-4ebd-821e-c04afdf1c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:21.794932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4ebc725-49bb-4ebd-821e-c04afdf1c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.795215 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7f7493c5-96d3-4464-b3af-51f77f7801a4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:21.795386 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4ebc725-49bb-4ebd-821e-c04afdf1c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.795935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7f7493c5-96d3-4464-b3af-51f77f7801a4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:21.796200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4ebc725-49bb-4ebd-821e-c04afdf1c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.796668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4ebc725-49bb-4ebd-821e-c04afdf1c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.802417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f7493c5-96d3-4464-b3af-51f77f7801a4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.802876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f7493c5-96d3-4464-b3af-51f77f7801a4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.803652 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f7493c5-96d3-4464-b3af-51f77f7801a4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.804087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f7493c5-96d3-4464-b3af-51f77f7801a4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:22.046363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a4ebc725-49bb-4ebd-821e-c04afdf1c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:22.048855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7f7493c5-96d3-4464-b3af-51f77f7801a4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:22.058291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a4ebc725-49bb-4ebd-821e-c04afdf1c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1709 microversion: 2.1 time: 0.276465 Jul 27 20:16:22.059550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 206/405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:21 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1709 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:22.062569 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7f7493c5-96d3-4464-b3af-51f77f7801a4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.271436 Jul 27 20:16:22.068461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 200/406] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:21 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:23.084183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9a55cb0f-4a0b-4390-8267-0869db1cb44d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:23.084817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9a55cb0f-4a0b-4390-8267-0869db1cb44d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:23.085663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-281936d5-b010-4586-9b2c-bea73f1389fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:23.086275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-281936d5-b010-4586-9b2c-bea73f1389fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:23.091516 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a55cb0f-4a0b-4390-8267-0869db1cb44d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:23.092187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a55cb0f-4a0b-4390-8267-0869db1cb44d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:23.093141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-281936d5-b010-4586-9b2c-bea73f1389fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:23.093325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a55cb0f-4a0b-4390-8267-0869db1cb44d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:23.093605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-281936d5-b010-4586-9b2c-bea73f1389fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:23.094092 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a55cb0f-4a0b-4390-8267-0869db1cb44d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:23.094375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-281936d5-b010-4586-9b2c-bea73f1389fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:23.094809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-281936d5-b010-4586-9b2c-bea73f1389fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:23.332840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-281936d5-b010-4586-9b2c-bea73f1389fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:23.341442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-281936d5-b010-4586-9b2c-bea73f1389fc tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.259846 Jul 27 20:16:23.342567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 201/407] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:23 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:23.346045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9a55cb0f-4a0b-4390-8267-0869db1cb44d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:23.354891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9a55cb0f-4a0b-4390-8267-0869db1cb44d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1709 microversion: 2.1 time: 0.274436 Jul 27 20:16:23.357066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 207/408] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:23 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1709 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:24.365706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0a03c4a5-ed70-491d-b5b6-8e80c902e252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:24.366428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0a03c4a5-ed70-491d-b5b6-8e80c902e252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:24.374775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a03c4a5-ed70-491d-b5b6-8e80c902e252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.374956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a03c4a5-ed70-491d-b5b6-8e80c902e252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:24.376317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a03c4a5-ed70-491d-b5b6-8e80c902e252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.376798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a03c4a5-ed70-491d-b5b6-8e80c902e252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:24.379573 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e855ac6c-d23c-4a70-8889-85c3bf7bf791 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:24.380365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e855ac6c-d23c-4a70-8889-85c3bf7bf791 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:24.387040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e855ac6c-d23c-4a70-8889-85c3bf7bf791 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.387732 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e855ac6c-d23c-4a70-8889-85c3bf7bf791 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:24.388911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e855ac6c-d23c-4a70-8889-85c3bf7bf791 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.389421 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e855ac6c-d23c-4a70-8889-85c3bf7bf791 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:24.632821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0a03c4a5-ed70-491d-b5b6-8e80c902e252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:24.640358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0a03c4a5-ed70-491d-b5b6-8e80c902e252 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.278572 Jul 27 20:16:24.651784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e855ac6c-d23c-4a70-8889-85c3bf7bf791 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:24.652654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 202/409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:24 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:24.654779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e855ac6c-d23c-4a70-8889-85c3bf7bf791 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1709 microversion: 2.1 time: 0.279672 Jul 27 20:16:24.656041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 208/410] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:24 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1709 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:24.808455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-89054843-c1c0-444b-a05e-f5daa0ffb886 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:24.808959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-89054843-c1c0-444b-a05e-f5daa0ffb886 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:24.814933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89054843-c1c0-444b-a05e-f5daa0ffb886 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.815386 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89054843-c1c0-444b-a05e-f5daa0ffb886 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:24.816145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89054843-c1c0-444b-a05e-f5daa0ffb886 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.816648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89054843-c1c0-444b-a05e-f5daa0ffb886 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:24.945958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-89054843-c1c0-444b-a05e-f5daa0ffb886 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'services' on Instance uuid 0eb47bd6-9456-46c6-b16a-552336fc32c4 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:16:25.332529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-89054843-c1c0-444b-a05e-f5daa0ffb886 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4/os-volume_attachments/775182ec-38f5-490e-a7c2-cd247c8081ba" status: 202 len: 0 microversion: 2.1 time: 0.527949 Jul 27 20:16:25.333050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 203/411] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:16:24 2022] DELETE /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4/os-volume_attachments/775182ec-38f5-490e-a7c2-cd247c8081ba => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:16:25.663235 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-75639887-34ad-432e-b0b0-557060906e11 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:25.663926 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-75639887-34ad-432e-b0b0-557060906e11 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:25.670923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75639887-34ad-432e-b0b0-557060906e11 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:25.671814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75639887-34ad-432e-b0b0-557060906e11 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:25.672720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75639887-34ad-432e-b0b0-557060906e11 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:25.673372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75639887-34ad-432e-b0b0-557060906e11 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:25.679739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-948b0a99-a447-46a2-b40d-a2c142ce6d79 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:25.681169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-948b0a99-a447-46a2-b40d-a2c142ce6d79 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:25.689044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-948b0a99-a447-46a2-b40d-a2c142ce6d79 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:25.689988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-948b0a99-a447-46a2-b40d-a2c142ce6d79 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:25.690924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-948b0a99-a447-46a2-b40d-a2c142ce6d79 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:25.691450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-948b0a99-a447-46a2-b40d-a2c142ce6d79 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:26.230348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-948b0a99-a447-46a2-b40d-a2c142ce6d79 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:26.247361 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-75639887-34ad-432e-b0b0-557060906e11 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:26.257226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-75639887-34ad-432e-b0b0-557060906e11 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.598073 Jul 27 20:16:26.257822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 209/412] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:25 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:26.263753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-948b0a99-a447-46a2-b40d-a2c142ce6d79 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1713 microversion: 2.1 time: 0.590182 Jul 27 20:16:26.264509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 204/413] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:25 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1713 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:26.929710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-2a326e9a-dfd8-4ea5-b4df-ea9897c51d30 req-2e791892-0763-4577-98fd-f62c29b2b91d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541f66f3-1a9d-4587-8012-c5636c1cd2ce", "name": "network-vif-plugged", "status": "completed", "tag": "60ef2664-40a6-420e-85c7-230bee398552"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:26.943165 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2a326e9a-dfd8-4ea5-b4df-ea9897c51d30 req-2e791892-0763-4577-98fd-f62c29b2b91d service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:26.943612 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2a326e9a-dfd8-4ea5-b4df-ea9897c51d30 req-2e791892-0763-4577-98fd-f62c29b2b91d service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:26.958429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-2a326e9a-dfd8-4ea5-b4df-ea9897c51d30 req-2e791892-0763-4577-98fd-f62c29b2b91d service nova] Creating event network-vif-plugged:60ef2664-40a6-420e-85c7-230bee398552 for instance 541f66f3-1a9d-4587-8012-c5636c1cd2ce on hv-cinder-85124 Jul 27 20:16:26.964018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-2a326e9a-dfd8-4ea5-b4df-ea9897c51d30 req-2e791892-0763-4577-98fd-f62c29b2b91d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039844 Jul 27 20:16:26.965265 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 210/414] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:27.278737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4b8a2182-68f2-4a13-a3b6-8181fec427db tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:27.279347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4b8a2182-68f2-4a13-a3b6-8181fec427db tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:27.285916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b8a2182-68f2-4a13-a3b6-8181fec427db tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:27.286708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b8a2182-68f2-4a13-a3b6-8181fec427db tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:27.287709 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b8a2182-68f2-4a13-a3b6-8181fec427db tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:27.288832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b8a2182-68f2-4a13-a3b6-8181fec427db tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:27.516278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4b8a2182-68f2-4a13-a3b6-8181fec427db tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:27.526567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4b8a2182-68f2-4a13-a3b6-8181fec427db tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.251657 Jul 27 20:16:27.528547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 205/415] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:27 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:27.904398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-44d4165a-e06d-4bc1-829b-9c8cd3d943c9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:27.906007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-44d4165a-e06d-4bc1-829b-9c8cd3d943c9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:27.913878 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44d4165a-e06d-4bc1-829b-9c8cd3d943c9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:27.915207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44d4165a-e06d-4bc1-829b-9c8cd3d943c9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:27.916191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44d4165a-e06d-4bc1-829b-9c8cd3d943c9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:27.916853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44d4165a-e06d-4bc1-829b-9c8cd3d943c9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:27.965818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-44d4165a-e06d-4bc1-829b-9c8cd3d943c9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:16:28.412666 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-44d4165a-e06d-4bc1-829b-9c8cd3d943c9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 204 len: 0 microversion: 2.1 time: 0.519634 Jul 27 20:16:28.413294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 211/416] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:16:27 2022] DELETE /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:16:28.428432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9642baae-864a-44f0-91fc-4c3716b189f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:28.428432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9642baae-864a-44f0-91fc-4c3716b189f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:28.434725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9642baae-864a-44f0-91fc-4c3716b189f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:28.435259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9642baae-864a-44f0-91fc-4c3716b189f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:28.436493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9642baae-864a-44f0-91fc-4c3716b189f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:28.437213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9642baae-864a-44f0-91fc-4c3716b189f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:28.549450 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-379cdb1d-61af-4f75-804e-04579419bb47 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:28.550157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-379cdb1d-61af-4f75-804e-04579419bb47 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:28.552079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:28.557279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-379cdb1d-61af-4f75-804e-04579419bb47 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:28.557727 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-379cdb1d-61af-4f75-804e-04579419bb47 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:28.558521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-379cdb1d-61af-4f75-804e-04579419bb47 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:28.558951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-379cdb1d-61af-4f75-804e-04579419bb47 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:28.596800 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9642baae-864a-44f0-91fc-4c3716b189f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:28.600731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:28.616757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9642baae-864a-44f0-91fc-4c3716b189f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1514 microversion: 2.1 time: 0.188005 Jul 27 20:16:28.616757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 206/417] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:28 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:28.738337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-379cdb1d-61af-4f75-804e-04579419bb47 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:28.746446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-379cdb1d-61af-4f75-804e-04579419bb47 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.201997 Jul 27 20:16:28.747350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 212/418] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:28 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:29.630933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f0877222-93d7-4cc3-b202-6415f6653fce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:29.630933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f0877222-93d7-4cc3-b202-6415f6653fce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:29.641942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0877222-93d7-4cc3-b202-6415f6653fce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:29.644087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0877222-93d7-4cc3-b202-6415f6653fce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:29.644956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0877222-93d7-4cc3-b202-6415f6653fce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:29.645389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0877222-93d7-4cc3-b202-6415f6653fce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:29.773095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-db4389f2-9f19-44a4-a1fc-c440efbe7f21 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:29.774599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-db4389f2-9f19-44a4-a1fc-c440efbe7f21 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:29.782081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db4389f2-9f19-44a4-a1fc-c440efbe7f21 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:29.782534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db4389f2-9f19-44a4-a1fc-c440efbe7f21 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:29.784098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db4389f2-9f19-44a4-a1fc-c440efbe7f21 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:29.784368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db4389f2-9f19-44a4-a1fc-c440efbe7f21 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:29.874353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f0877222-93d7-4cc3-b202-6415f6653fce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:29.882474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f0877222-93d7-4cc3-b202-6415f6653fce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1514 microversion: 2.1 time: 0.257724 Jul 27 20:16:29.885409 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 207/419] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:29 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:29.946659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-db4389f2-9f19-44a4-a1fc-c440efbe7f21 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:29.956586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-db4389f2-9f19-44a4-a1fc-c440efbe7f21 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1370 microversion: 2.1 time: 0.188807 Jul 27 20:16:29.956586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 213/420] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:29 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:30.909034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-003c2551-9821-4a89-8d04-03f6d3d3dd78 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:30.909836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-003c2551-9821-4a89-8d04-03f6d3d3dd78 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:30.912154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:30.918708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-003c2551-9821-4a89-8d04-03f6d3d3dd78 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:30.919157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-003c2551-9821-4a89-8d04-03f6d3d3dd78 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:30.924075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-003c2551-9821-4a89-8d04-03f6d3d3dd78 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:30.924075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-003c2551-9821-4a89-8d04-03f6d3d3dd78 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:30.977841 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-30d0585c-59cf-48e0-bf10-7e32990f121d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:30.978574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-30d0585c-59cf-48e0-bf10-7e32990f121d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:30.986294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30d0585c-59cf-48e0-bf10-7e32990f121d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:30.986790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30d0585c-59cf-48e0-bf10-7e32990f121d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:30.987571 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30d0585c-59cf-48e0-bf10-7e32990f121d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:30.988013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30d0585c-59cf-48e0-bf10-7e32990f121d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:31.156261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-003c2551-9821-4a89-8d04-03f6d3d3dd78 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:31.165754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-003c2551-9821-4a89-8d04-03f6d3d3dd78 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1514 microversion: 2.1 time: 0.259240 Jul 27 20:16:31.167453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 208/421] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:30 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:31.207738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-30d0585c-59cf-48e0-bf10-7e32990f121d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:31.216804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-30d0585c-59cf-48e0-bf10-7e32990f121d tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1563 microversion: 2.1 time: 0.244211 Jul 27 20:16:31.217711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 214/422] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:30 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:31.240987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aafa3ae9-1f00-48c1-b28e-6e5cbe0043a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:31.240987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aafa3ae9-1f00-48c1-b28e-6e5cbe0043a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:31.248806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aafa3ae9-1f00-48c1-b28e-6e5cbe0043a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:31.249247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aafa3ae9-1f00-48c1-b28e-6e5cbe0043a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:31.250206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aafa3ae9-1f00-48c1-b28e-6e5cbe0043a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:31.250922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aafa3ae9-1f00-48c1-b28e-6e5cbe0043a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:31.350141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aafa3ae9-1f00-48c1-b28e-6e5cbe0043a2 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115333 Jul 27 20:16:31.358666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 209/423] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 20:16:31 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:32.189535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f27308e1-7643-45fa-832c-d82214dede68 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:32.191271 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f27308e1-7643-45fa-832c-d82214dede68 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:32.201008 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f27308e1-7643-45fa-832c-d82214dede68 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:32.201652 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f27308e1-7643-45fa-832c-d82214dede68 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:32.204471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f27308e1-7643-45fa-832c-d82214dede68 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:32.205097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f27308e1-7643-45fa-832c-d82214dede68 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:32.486435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f27308e1-7643-45fa-832c-d82214dede68 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:32.497957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:32.500584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f27308e1-7643-45fa-832c-d82214dede68 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1514 microversion: 2.1 time: 0.315627 Jul 27 20:16:32.510455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 215/424] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:32 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:32.667534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-7bfa8bdc-c667-472d-af0f-fa6e526a568f req-f1cae7be-e6f2-4c39-aa9c-964388171322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541f66f3-1a9d-4587-8012-c5636c1cd2ce", "tag": "60ef2664-40a6-420e-85c7-230bee398552"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:32.677835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-7bfa8bdc-c667-472d-af0f-fa6e526a568f req-f1cae7be-e6f2-4c39-aa9c-964388171322 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:32.678631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-7bfa8bdc-c667-472d-af0f-fa6e526a568f req-f1cae7be-e6f2-4c39-aa9c-964388171322 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:32.693210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-7bfa8bdc-c667-472d-af0f-fa6e526a568f req-f1cae7be-e6f2-4c39-aa9c-964388171322 service nova] Creating event network-changed:60ef2664-40a6-420e-85c7-230bee398552 for instance 541f66f3-1a9d-4587-8012-c5636c1cd2ce on hv-cinder-85124 Jul 27 20:16:32.698803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-7bfa8bdc-c667-472d-af0f-fa6e526a568f req-f1cae7be-e6f2-4c39-aa9c-964388171322 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035914 Jul 27 20:16:32.700148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 210/425] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:33.528898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dbf520b6-bbc3-4e56-b5b4-18bc8328f5d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:33.529805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dbf520b6-bbc3-4e56-b5b4-18bc8328f5d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:33.538533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dbf520b6-bbc3-4e56-b5b4-18bc8328f5d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:33.539087 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dbf520b6-bbc3-4e56-b5b4-18bc8328f5d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:33.539952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dbf520b6-bbc3-4e56-b5b4-18bc8328f5d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:33.540586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dbf520b6-bbc3-4e56-b5b4-18bc8328f5d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:33.751100 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dbf520b6-bbc3-4e56-b5b4-18bc8328f5d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:33.762481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dbf520b6-bbc3-4e56-b5b4-18bc8328f5d7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1514 microversion: 2.1 time: 0.241871 Jul 27 20:16:33.764241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 216/426] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:33 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:34.793830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1f217114-84d3-4954-b5fd-81bc2359c47a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:34.795282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1f217114-84d3-4954-b5fd-81bc2359c47a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:34.803198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f217114-84d3-4954-b5fd-81bc2359c47a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:34.803807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f217114-84d3-4954-b5fd-81bc2359c47a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:34.804910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f217114-84d3-4954-b5fd-81bc2359c47a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:34.805445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f217114-84d3-4954-b5fd-81bc2359c47a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:35.335331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1f217114-84d3-4954-b5fd-81bc2359c47a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:35.347635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1f217114-84d3-4954-b5fd-81bc2359c47a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1514 microversion: 2.1 time: 0.564286 Jul 27 20:16:35.355092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 211/427] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:34 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1514 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:35.940326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-2f099d79-b8e6-47b4-b2f3-16b2390c8b2b req-a92e4c52-73af-4d6d-ba48-bff3e765fdfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb47bd6-9456-46c6-b16a-552336fc32c4", "name": "network-vif-deleted", "tag": "1f6b19f5-9290-4aaf-aa9c-8d8f8744dd6a"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:35.948663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2f099d79-b8e6-47b4-b2f3-16b2390c8b2b req-a92e4c52-73af-4d6d-ba48-bff3e765fdfc service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:35.949330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2f099d79-b8e6-47b4-b2f3-16b2390c8b2b req-a92e4c52-73af-4d6d-ba48-bff3e765fdfc service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:35.963264 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-2f099d79-b8e6-47b4-b2f3-16b2390c8b2b req-a92e4c52-73af-4d6d-ba48-bff3e765fdfc service nova] Creating event network-vif-deleted:1f6b19f5-9290-4aaf-aa9c-8d8f8744dd6a for instance 0eb47bd6-9456-46c6-b16a-552336fc32c4 on hv-cinder-85124 Jul 27 20:16:35.968984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-2f099d79-b8e6-47b4-b2f3-16b2390c8b2b req-a92e4c52-73af-4d6d-ba48-bff3e765fdfc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036203 Jul 27 20:16:35.970112 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 217/428] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:36.377004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:36.378976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:36.389286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:36.389899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:36.390802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:36.391341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:36.432663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:36.433032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:36.433489 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'fault' on Instance uuid 0eb47bd6-9456-46c6-b16a-552336fc32c4 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:16:36.484419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:36.493553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-88a55360-f681-42f7-acbf-54b385bf4fe0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1309 microversion: 2.1 time: 0.121436 Jul 27 20:16:36.494451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 212/429] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:36 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:37.515866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:37.516725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:37.529143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:37.529590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:37.530393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:37.530905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:37.569187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:37.569546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:37.571970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'fault' on Instance uuid 0eb47bd6-9456-46c6-b16a-552336fc32c4 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:16:37.625808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6e54c01d-3eea-4806-b569-2ff763448cea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Action: 'create', calling method: .version_select at 0x7f35ca4d6c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1931530333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQ1ChZEUjUeXUU1MBzr0ZYkOeoIFKxX9rRdohMiSuNbN7nDvKTq1A3sl+1132DLJ7gscnA4ERWZBGgvLOUw6ywjGgzDzAhWcrxfAjaU9cZDSPsFwj8rIe1w27n1m73wSQ=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:37.631310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:37.640058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cac72c24-d4d2-45b9-95fd-188b13590ca4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 200 len: 1309 microversion: 2.1 time: 0.128908 Jul 27 20:16:37.641265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 213/430] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:37 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 1309 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:37.657439 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-6e54c01d-3eea-4806-b569-2ff763448cea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Getting quotas for project 55c519d693b2424b9e0acc02143c6e6a. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:16:37.661496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-6e54c01d-3eea-4806-b569-2ff763448cea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Getting quotas for user a726227067d2499e9934a824fc4c31a5 and project 55c519d693b2424b9e0acc02143c6e6a. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:16:37.779700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6e54c01d-3eea-4806-b569-2ff763448cea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.385128 Jul 27 20:16:37.780312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 218/431] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:16:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:38.662300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:38.662940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 0eb47bd6-9456-46c6-b16a-552336fc32c4] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:38.670695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:38.671147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:38.671968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:38.672631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:38.690939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] HTTP exception thrown: Instance 0eb47bd6-9456-46c6-b16a-552336fc32c4 could not be found. Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Request method failure captured: Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 HTTP/1.1 Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZylluivMbvq1djrnXMUVeBVGunbYVXh6D3d_iyn1pPfemmbHxnif7Ab9T03dfOSAK0i6Nk3WXV2mjw_fCKDeIG3-C9Rq1b76LHyCRBpFDeKwt7XcDHRJSLxWxUB8LIbDH3D__sExdSCcybRzHwVCi_z5_qVu7MkcX6Bjm1lRPdE-Bg Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:16:38.692701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8054a20f70e6408ebe06c787887d0b16", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 8f2d8cdf0e0d48f4a89a0e85694c3372 Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 0eb47bd6-9456-46c6-b16a-552336fc32c4 could not be found. Jul 27 20:16:38.693971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '0eb47bd6-9456-46c6-b16a-552336fc32c4'} Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb47bd6-9456-46c6-b16a-552336fc32c4 could not be found. Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:16:38.694724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb47bd6-9456-46c6-b16a-552336fc32c4 could not be found. Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb47bd6-9456-46c6-b16a-552336fc32c4 could not be found. Jul 27 20:16:38.696714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:16:38.699682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Returning 404 to user: Instance 0eb47bd6-9456-46c6-b16a-552336fc32c4 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:16:38.699682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ff25616-b365-44d1-bd06-76c4ba8f2192 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4" status: 404 len: 111 microversion: 2.1 time: 0.035732 Jul 27 20:16:38.699682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 214/432] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:38 2022] GET /compute/v2.1/servers/0eb47bd6-9456-46c6-b16a-552336fc32c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:16:49.200157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:16:49.200828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:16:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:16:49.415637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=9 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:49.416562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:49.417175 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:49.421027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1091896633", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "networks": [{"uuid": "af698b61-79e3-453b-8e69-bec8a017326f"}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:49.475048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] validate_networks() for [('af698b61-79e3-453b-8e69-bec8a017326f', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:16:49.831601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:16:49.832090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:16:49.832587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:16:49.833009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:16:49.833395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:16:49.842909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:49.843504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:49.844113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:49.844575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:49.860455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Getting quotas for project 8054a20f70e6408ebe06c787887d0b16. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:16:49.864320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Getting quotas for user 8f2d8cdf0e0d48f4a89a0e85694c3372 and project 8054a20f70e6408ebe06c787887d0b16. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:16:49.875285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:16:49.877667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:16:50.001528 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-211f2271-0a5f-43c5-9d82-ddfc1424ab8f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587998 Jul 27 20:16:50.002174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 219/433] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:16:50.013475 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e16e3c7c-5efa-4836-8954-367ba7d7a284 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:50.014322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e16e3c7c-5efa-4836-8954-367ba7d7a284 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:50.017060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=17 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:50.017937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=42 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:50.070612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e16e3c7c-5efa-4836-8954-367ba7d7a284 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:50.077854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e16e3c7c-5efa-4836-8954-367ba7d7a284 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1219 microversion: 2.1 time: 0.068211 Jul 27 20:16:50.078412 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 215/434] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:50 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:51.098720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c152094a-7749-43f9-8022-fbf12a2d079a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:51.099322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c152094a-7749-43f9-8022-fbf12a2d079a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:51.107376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c152094a-7749-43f9-8022-fbf12a2d079a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:51.107824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c152094a-7749-43f9-8022-fbf12a2d079a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:51.108606 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c152094a-7749-43f9-8022-fbf12a2d079a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:51.109033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c152094a-7749-43f9-8022-fbf12a2d079a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:51.171569 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c152094a-7749-43f9-8022-fbf12a2d079a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:51.179258 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c152094a-7749-43f9-8022-fbf12a2d079a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1223 microversion: 2.1 time: 0.084466 Jul 27 20:16:51.180126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 220/435] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:51 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:52.200137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a0998611-f816-45c2-87fe-df65eeb3631d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:52.200785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a0998611-f816-45c2-87fe-df65eeb3631d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:52.207882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0998611-f816-45c2-87fe-df65eeb3631d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:52.208373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0998611-f816-45c2-87fe-df65eeb3631d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:52.209165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0998611-f816-45c2-87fe-df65eeb3631d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:52.209599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0998611-f816-45c2-87fe-df65eeb3631d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:52.242394 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cae80728-82c7-48e0-a817-d3d2db832b25 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:52.243046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cae80728-82c7-48e0-a817-d3d2db832b25 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:52.250105 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cae80728-82c7-48e0-a817-d3d2db832b25 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:52.250631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cae80728-82c7-48e0-a817-d3d2db832b25 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:52.251480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cae80728-82c7-48e0-a817-d3d2db832b25 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:52.252004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cae80728-82c7-48e0-a817-d3d2db832b25 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:52.277062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cae80728-82c7-48e0-a817-d3d2db832b25 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/ips" status: 200 len: 152 microversion: 2.20 time: 0.040504 Jul 27 20:16:52.278147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 221/436] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Jul 27 20:16:52 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:16:52.287224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0998611-f816-45c2-87fe-df65eeb3631d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:52.295548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a0998611-f816-45c2-87fe-df65eeb3631d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1279 microversion: 2.1 time: 0.099688 Jul 27 20:16:52.296129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 216/437] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:52 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:53.320839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7bc60577-9bbf-4121-9f9a-0b743e5b51a3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:53.321474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7bc60577-9bbf-4121-9f9a-0b743e5b51a3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:53.327876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7bc60577-9bbf-4121-9f9a-0b743e5b51a3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:53.328320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7bc60577-9bbf-4121-9f9a-0b743e5b51a3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:53.329186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7bc60577-9bbf-4121-9f9a-0b743e5b51a3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:53.329614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7bc60577-9bbf-4121-9f9a-0b743e5b51a3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:53.515910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7bc60577-9bbf-4121-9f9a-0b743e5b51a3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:53.523225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7bc60577-9bbf-4121-9f9a-0b743e5b51a3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1319 microversion: 2.1 time: 0.206931 Jul 27 20:16:53.523794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 222/438] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:53 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:54.179207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-72d133c8-53b0-45e1-acc3-dfe92a9534a0 req-5163026d-4049-4a41-bc85-54e749f3a5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9fd4e2-6f6c-4826-96f5-09b52de8f200", "tag": "4c21a1d5-3c73-4b7d-88c0-88411bae4727"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:54.190470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-72d133c8-53b0-45e1-acc3-dfe92a9534a0 req-5163026d-4049-4a41-bc85-54e749f3a5fd service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:54.190834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-72d133c8-53b0-45e1-acc3-dfe92a9534a0 req-5163026d-4049-4a41-bc85-54e749f3a5fd service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:54.203023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-72d133c8-53b0-45e1-acc3-dfe92a9534a0 req-5163026d-4049-4a41-bc85-54e749f3a5fd service nova] Creating event network-changed:4c21a1d5-3c73-4b7d-88c0-88411bae4727 for instance 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 on hv-cinder-85124 Jul 27 20:16:54.208039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-72d133c8-53b0-45e1-acc3-dfe92a9534a0 req-5163026d-4049-4a41-bc85-54e749f3a5fd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033905 Jul 27 20:16:54.208919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 217/439] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:54.544752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c4bc48b5-0802-4cec-bb32-7be2b225a836 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:54.545418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c4bc48b5-0802-4cec-bb32-7be2b225a836 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:54.551990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4bc48b5-0802-4cec-bb32-7be2b225a836 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:54.552470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4bc48b5-0802-4cec-bb32-7be2b225a836 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:54.553238 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4bc48b5-0802-4cec-bb32-7be2b225a836 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:54.553671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4bc48b5-0802-4cec-bb32-7be2b225a836 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:54.727991 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-be90b30f-7501-4b9f-bce8-9915ffd48afa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:16:54.728649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-be90b30f-7501-4b9f-bce8-9915ffd48afa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:54.735011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be90b30f-7501-4b9f-bce8-9915ffd48afa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:54.735451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be90b30f-7501-4b9f-bce8-9915ffd48afa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:54.736212 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be90b30f-7501-4b9f-bce8-9915ffd48afa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:54.736672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be90b30f-7501-4b9f-bce8-9915ffd48afa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:54.762440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-be90b30f-7501-4b9f-bce8-9915ffd48afa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lazy-loading 'flavor' on Instance uuid 0929536d-2d91-4e59-8f36-474025d921ef {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:16:54.783262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c4bc48b5-0802-4cec-bb32-7be2b225a836 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:54.790566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c4bc48b5-0802-4cec-bb32-7be2b225a836 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1319 microversion: 2.1 time: 0.249784 Jul 27 20:16:54.791135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 223/440] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:54 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:55.262202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-be90b30f-7501-4b9f-bce8-9915ffd48afa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "POST /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/action" status: 202 len: 0 microversion: 2.20 time: 0.538397 Jul 27 20:16:55.262819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 218/441] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Jul 27 20:16:54 2022] POST /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 20:16:55.270853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:55.271471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:55.277457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:55.277907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:55.284224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:55.284224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:55.424639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:55.430629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:55.432181 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:55.433357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-02f75f79-bc01-4175-ab56-5c8ae2098c80 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.166305 Jul 27 20:16:55.433918 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 224/442] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:16:55 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:16:55.811794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e0ce56a-b22b-4741-a19c-95439b93a731 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:55.812516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7e0ce56a-b22b-4741-a19c-95439b93a731 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:55.818839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e0ce56a-b22b-4741-a19c-95439b93a731 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:55.819281 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e0ce56a-b22b-4741-a19c-95439b93a731 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:55.820574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e0ce56a-b22b-4741-a19c-95439b93a731 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:55.821000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e0ce56a-b22b-4741-a19c-95439b93a731 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:55.956952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7e0ce56a-b22b-4741-a19c-95439b93a731 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:55.965003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7e0ce56a-b22b-4741-a19c-95439b93a731 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1319 microversion: 2.1 time: 0.157605 Jul 27 20:16:55.965563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 219/443] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:55 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:56.456273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:56.456932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:56.463451 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:56.463902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:56.464727 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:56.465303 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:56.599871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:56.608271 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:56.609936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:56.611113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-33fa8d33-3c67-4067-ba2c-98e845038e7e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.158787 Jul 27 20:16:56.611675 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 225/444] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:16:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:16:56.986017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bc37b627-9aaa-48a4-80a1-34d9b77d3ac5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:56.986617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bc37b627-9aaa-48a4-80a1-34d9b77d3ac5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:56.993331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc37b627-9aaa-48a4-80a1-34d9b77d3ac5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:56.993770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc37b627-9aaa-48a4-80a1-34d9b77d3ac5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:56.994517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc37b627-9aaa-48a4-80a1-34d9b77d3ac5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:56.994942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc37b627-9aaa-48a4-80a1-34d9b77d3ac5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:57.128905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bc37b627-9aaa-48a4-80a1-34d9b77d3ac5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:57.136789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bc37b627-9aaa-48a4-80a1-34d9b77d3ac5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1319 microversion: 2.1 time: 0.154591 Jul 27 20:16:57.137351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 220/445] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:56 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:57.634735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:57.635364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:57.641839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:57.642292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:57.643095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:57.643529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:57.775803 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:57.784140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:57.785711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:57.786873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d248566b-d8c3-4f39-9d88-e108a34aa99e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.156752 Jul 27 20:16:57.788586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 226/446] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:16:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:16:58.159163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-63b96e91-f23c-499c-94c3-75b22d3430de tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:58.160355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-63b96e91-f23c-499c-94c3-75b22d3430de tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:58.167612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63b96e91-f23c-499c-94c3-75b22d3430de tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:58.168355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63b96e91-f23c-499c-94c3-75b22d3430de tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:58.169637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63b96e91-f23c-499c-94c3-75b22d3430de tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:58.170387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63b96e91-f23c-499c-94c3-75b22d3430de tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:58.306097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-63b96e91-f23c-499c-94c3-75b22d3430de tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:58.313835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-63b96e91-f23c-499c-94c3-75b22d3430de tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1319 microversion: 2.1 time: 0.159300 Jul 27 20:16:58.328578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 221/447] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:58 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:58.811419 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:58.812045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:58.819058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:58.820053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:58.820878 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:58.821313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:58.952776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:58.961242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:58.962754 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:58.963905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7c4fed93-49dd-4359-b136-b5b2eb0407db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.156577 Jul 27 20:16:58.964585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 227/448] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:16:58 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:16:59.337965 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-59718caa-93e8-4ff3-94ab-6a897592f132 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:59.339347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-59718caa-93e8-4ff3-94ab-6a897592f132 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:59.346056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59718caa-93e8-4ff3-94ab-6a897592f132 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:59.346511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59718caa-93e8-4ff3-94ab-6a897592f132 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:59.347282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59718caa-93e8-4ff3-94ab-6a897592f132 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:59.347715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59718caa-93e8-4ff3-94ab-6a897592f132 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:59.481105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-59718caa-93e8-4ff3-94ab-6a897592f132 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:59.488675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-59718caa-93e8-4ff3-94ab-6a897592f132 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1319 microversion: 2.1 time: 0.154623 Jul 27 20:16:59.489233 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 222/449] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:59 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:59.987044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:59.987644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:59.989939 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:59.990596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:59.996221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:59.996712 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:59.997460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:59.997889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:00.126058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:00.134700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:00.136246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:00.137490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-61f127de-1a8a-49c2-b034-a1dc203586be tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.154322 Jul 27 20:17:00.138073 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 228/450] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:16:59 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:00.509741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7b32bef4-a282-4ee7-af93-b3a9efe0cf57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:00.510297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7b32bef4-a282-4ee7-af93-b3a9efe0cf57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:00.512272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:00.517619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b32bef4-a282-4ee7-af93-b3a9efe0cf57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:00.518072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b32bef4-a282-4ee7-af93-b3a9efe0cf57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:00.518833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b32bef4-a282-4ee7-af93-b3a9efe0cf57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:00.519267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b32bef4-a282-4ee7-af93-b3a9efe0cf57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:00.650680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7b32bef4-a282-4ee7-af93-b3a9efe0cf57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:00.658076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7b32bef4-a282-4ee7-af93-b3a9efe0cf57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1319 microversion: 2.1 time: 0.152378 Jul 27 20:17:00.658650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 223/451] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:00 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:00.805108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-5d630b68-5dd2-4bf3-b642-b8f83a7b56f1 req-f2871e4c-4f39-4990-a365-4acea32bd717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9fd4e2-6f6c-4826-96f5-09b52de8f200", "name": "network-vif-plugged", "status": "completed", "tag": "4c21a1d5-3c73-4b7d-88c0-88411bae4727"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:17:00.814699 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-5d630b68-5dd2-4bf3-b642-b8f83a7b56f1 req-f2871e4c-4f39-4990-a365-4acea32bd717 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:00.815143 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-5d630b68-5dd2-4bf3-b642-b8f83a7b56f1 req-f2871e4c-4f39-4990-a365-4acea32bd717 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:00.825763 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-5d630b68-5dd2-4bf3-b642-b8f83a7b56f1 req-f2871e4c-4f39-4990-a365-4acea32bd717 service nova] Creating event network-vif-plugged:4c21a1d5-3c73-4b7d-88c0-88411bae4727 for instance 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 on hv-cinder-85124 Jul 27 20:17:00.830992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-5d630b68-5dd2-4bf3-b642-b8f83a7b56f1 req-f2871e4c-4f39-4990-a365-4acea32bd717 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030022 Jul 27 20:17:00.831983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 229/452] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:17:01.159230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:01.159772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:01.167104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:01.167623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:01.168616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:01.169266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:01.311634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:01.319832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:01.323196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:01.323196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dfc878f6-22c2-4ad1-9ab8-149ba7d18dd0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.167906 Jul 27 20:17:01.323609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 224/453] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:01.682626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f48e613c-7398-4d2e-8846-93e8bd63a7b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:01.683324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f48e613c-7398-4d2e-8846-93e8bd63a7b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:01.690173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f48e613c-7398-4d2e-8846-93e8bd63a7b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:01.690856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f48e613c-7398-4d2e-8846-93e8bd63a7b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:01.691370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f48e613c-7398-4d2e-8846-93e8bd63a7b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:01.691809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f48e613c-7398-4d2e-8846-93e8bd63a7b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:01.824750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f48e613c-7398-4d2e-8846-93e8bd63a7b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:01.832184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f48e613c-7398-4d2e-8846-93e8bd63a7b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1319 microversion: 2.1 time: 0.154344 Jul 27 20:17:01.832777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 230/454] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:01 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:02.346867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:02.347477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:02.354748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:02.355193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:02.355944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:02.356372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:02.484446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:02.492873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:02.494396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:02.495550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-76ad5a6e-e885-4de4-97a4-e89d3becace0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.152601 Jul 27 20:17:02.496116 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 225/455] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:02 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:02.853137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e0205397-cac9-4726-af85-dcdfbb3782a5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:02.853753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e0205397-cac9-4726-af85-dcdfbb3782a5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:02.860606 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e0205397-cac9-4726-af85-dcdfbb3782a5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:02.861057 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e0205397-cac9-4726-af85-dcdfbb3782a5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:02.861811 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e0205397-cac9-4726-af85-dcdfbb3782a5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:02.862248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e0205397-cac9-4726-af85-dcdfbb3782a5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:02.995071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e0205397-cac9-4726-af85-dcdfbb3782a5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:03.002466 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e0205397-cac9-4726-af85-dcdfbb3782a5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1319 microversion: 2.1 time: 0.153203 Jul 27 20:17:03.003029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 231/456] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:02 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:03.518737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:03.519341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:03.525771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:03.526209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:03.526951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:03.527376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:03.656225 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:03.664773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:03.666292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:03.667433 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2a10e3f7-5ef5-4d9d-a24b-ef058458493c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.152645 Jul 27 20:17:03.668004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 226/457] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:04.025578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0718ee1b-c0c2-4795-bb80-598412f6245f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:04.026185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0718ee1b-c0c2-4795-bb80-598412f6245f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:04.032617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0718ee1b-c0c2-4795-bb80-598412f6245f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:04.033065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0718ee1b-c0c2-4795-bb80-598412f6245f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:04.033809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0718ee1b-c0c2-4795-bb80-598412f6245f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:04.034246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0718ee1b-c0c2-4795-bb80-598412f6245f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:04.162014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0718ee1b-c0c2-4795-bb80-598412f6245f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:04.169452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0718ee1b-c0c2-4795-bb80-598412f6245f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1508 microversion: 2.1 time: 0.148471 Jul 27 20:17:04.170023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 232/458] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:04 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:04.189615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-95f68084-b81d-48a0-8840-1a73b3e7718e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc1b3900-8a06-4de9-97a5-8c519ba578ec", "device": "/dev/sdb"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:17:04.192613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-95f68084-b81d-48a0-8840-1a73b3e7718e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:04.198998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95f68084-b81d-48a0-8840-1a73b3e7718e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:04.199440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95f68084-b81d-48a0-8840-1a73b3e7718e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:04.200195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95f68084-b81d-48a0-8840-1a73b3e7718e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:04.200657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95f68084-b81d-48a0-8840-1a73b3e7718e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:04.689975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:04.690530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:04.697295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:04.700688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:04.700688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:04.700688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:04.832565 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:04.840491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:04.842062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:04.843510 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b5b34483-0a60-47cd-aebf-98ea9cc6adea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.157547 Jul 27 20:17:04.844074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 233/459] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:04 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:17:04.945446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-95f68084-b81d-48a0-8840-1a73b3e7718e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "POST /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.759499 Jul 27 20:17:04.946039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 227/460] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:17:04 2022] POST /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:17:05.561342 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-677998637", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1931530333", "security_groups": [{"name": "tempest-secgroup-smoke-702732310"}], "networks": [{"uuid": "6dba5390-6c00-4274-a6cf-3d4885e5c721"}], "block_device_mapping_v2": [{"uuid": "b9586f64-cbb1-413b-b7fa-459a55aab13a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:17:05.672720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] validate_networks() for [('6dba5390-6c00-4274-a6cf-3d4885e5c721', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:17:05.868892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:05.869509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:05.875656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:05.876100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:05.876876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:05.877308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:06.108084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:06.116158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:06.118073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:06.119393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f6a4765f-c67a-4d60-9a42-82033314ce91 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.256015 Jul 27 20:17:06.120044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 228/461] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:05 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:17:06.122192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:17:06.122607 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:17:06.123100 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:17:06.123501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:17:06.123901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:17:06.132578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:06.133016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:06.133800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:06.134228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:06.150541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Getting quotas for project 55c519d693b2424b9e0acc02143c6e6a. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:17:06.154368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Getting quotas for user a726227067d2499e9934a824fc4c31a5 and project 55c519d693b2424b9e0acc02143c6e6a. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:17:06.210505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:17:06.213107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9586f64-cbb1-413b-b7fa-459a55aab13a',volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:17:06.565921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f4327cdd-0786-4adf-828b-db46d6300030 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.008334 Jul 27 20:17:06.566615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 234/462] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:17:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:17:06.578258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8faf0c55-bfca-480c-9b56-9cc4b262a3b3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:06.578870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8faf0c55-bfca-480c-9b56-9cc4b262a3b3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:06.634155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8faf0c55-bfca-480c-9b56-9cc4b262a3b3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:06.641453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8faf0c55-bfca-480c-9b56-9cc4b262a3b3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1088 microversion: 2.1 time: 0.067290 Jul 27 20:17:06.642016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 229/463] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:07.142542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:07.143160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:07.149376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:07.149828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:07.150588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:07.151027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:07.281125 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:07.289302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:07.291296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:07.292457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f3bea711-08ba-4b6d-b8a3-59e46d72fb5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.154568 Jul 27 20:17:07.293010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 235/464] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:07 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:07.661894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7f21e5d4-9de0-4285-8f79-6050ba91cee2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:07.662493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7f21e5d4-9de0-4285-8f79-6050ba91cee2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:07.670125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f21e5d4-9de0-4285-8f79-6050ba91cee2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:07.670571 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f21e5d4-9de0-4285-8f79-6050ba91cee2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:07.671355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f21e5d4-9de0-4285-8f79-6050ba91cee2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:07.671780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f21e5d4-9de0-4285-8f79-6050ba91cee2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:07.734730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7f21e5d4-9de0-4285-8f79-6050ba91cee2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:07.740203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:07.742835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7f21e5d4-9de0-4285-8f79-6050ba91cee2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1138 microversion: 2.1 time: 0.084742 Jul 27 20:17:07.743389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 230/465] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:08.315288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:08.315898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:08.322485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:08.322942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:08.323698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:08.324132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:08.452773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:08.460620 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:08.465597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:08.465597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0e15baeb-4f6e-4d56-bad2-b43b17057072 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.151979 Jul 27 20:17:08.465597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 236/466] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:08 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:08.763958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f3bec0f3-db51-4818-a9e3-2843e7e8ad16 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:08.764727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f3bec0f3-db51-4818-a9e3-2843e7e8ad16 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:08.772577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3bec0f3-db51-4818-a9e3-2843e7e8ad16 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:08.773057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3bec0f3-db51-4818-a9e3-2843e7e8ad16 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:08.773876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3bec0f3-db51-4818-a9e3-2843e7e8ad16 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:08.774317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3bec0f3-db51-4818-a9e3-2843e7e8ad16 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:08.851330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f3bec0f3-db51-4818-a9e3-2843e7e8ad16 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:08.859604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f3bec0f3-db51-4818-a9e3-2843e7e8ad16 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1194 microversion: 2.1 time: 0.099899 Jul 27 20:17:08.868235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 231/467] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:08 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:09.485254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:09.485860 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:09.492548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:09.492998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:09.493752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:09.494184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:09.751549 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:09.755883 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:09.762406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:09.764337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:09.765789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-16336267-f899-4d2f-bc0f-eefa9308810d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.284497 Jul 27 20:17:09.766744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 237/468] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:09.882934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-353c78bc-02b9-4e4c-95a5-65dd3c2bee4f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:09.882934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-353c78bc-02b9-4e4c-95a5-65dd3c2bee4f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:09.890235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-353c78bc-02b9-4e4c-95a5-65dd3c2bee4f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:09.890690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-353c78bc-02b9-4e4c-95a5-65dd3c2bee4f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:09.891455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-353c78bc-02b9-4e4c-95a5-65dd3c2bee4f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:09.891892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-353c78bc-02b9-4e4c-95a5-65dd3c2bee4f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:10.329165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-353c78bc-02b9-4e4c-95a5-65dd3c2bee4f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:10.336877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-353c78bc-02b9-4e4c-95a5-65dd3c2bee4f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1271 microversion: 2.1 time: 0.459162 Jul 27 20:17:10.339486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 232/469] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:09 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1271 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:10.756697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-393c474d-5a19-4cf3-85f1-24d6fbd464b1 req-d7314899-dcec-4dec-a619-dfc31d2c5457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af31f4cf-e692-45de-8dd8-242a7c0279fa", "tag": "94ac9417-69b9-4849-a622-d6629e497fed"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:17:10.767996 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-393c474d-5a19-4cf3-85f1-24d6fbd464b1 req-d7314899-dcec-4dec-a619-dfc31d2c5457 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:10.768827 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-393c474d-5a19-4cf3-85f1-24d6fbd464b1 req-d7314899-dcec-4dec-a619-dfc31d2c5457 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:10.784283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-393c474d-5a19-4cf3-85f1-24d6fbd464b1 req-d7314899-dcec-4dec-a619-dfc31d2c5457 service nova] Creating event network-changed:94ac9417-69b9-4849-a622-d6629e497fed for instance af31f4cf-e692-45de-8dd8-242a7c0279fa on hv-cinder-85124 Jul 27 20:17:10.788192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:10.788919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:10.789515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-393c474d-5a19-4cf3-85f1-24d6fbd464b1 req-d7314899-dcec-4dec-a619-dfc31d2c5457 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038164 Jul 27 20:17:10.790113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 238/470] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:17:10.796141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:10.796696 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:10.797766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:10.798273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:11.010297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:11.018429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:11.019943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:11.021160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e8a13961-b833-41ef-a2b3-72fec3d21962 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.236962 Jul 27 20:17:11.021926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 233/471] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:11.358600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-350b1d4e-176c-43b8-88ae-643bc8af3df4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:11.365302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-350b1d4e-176c-43b8-88ae-643bc8af3df4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:11.365483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-350b1d4e-176c-43b8-88ae-643bc8af3df4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:11.365938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-350b1d4e-176c-43b8-88ae-643bc8af3df4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:11.366964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-350b1d4e-176c-43b8-88ae-643bc8af3df4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:11.367400 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-350b1d4e-176c-43b8-88ae-643bc8af3df4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:11.503207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-350b1d4e-176c-43b8-88ae-643bc8af3df4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:11.510946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-350b1d4e-176c-43b8-88ae-643bc8af3df4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1271 microversion: 2.1 time: 0.156330 Jul 27 20:17:11.511530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 239/472] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:12.044559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:12.045166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:12.051599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:12.052043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:12.052814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:12.053245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:12.180983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:12.188859 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:12.190377 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:12.191525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-91f7934f-a3d1-416a-8b0e-0d5a46b77013 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1723 microversion: 2.20 time: 0.151593 Jul 27 20:17:12.192093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 234/473] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:12 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:12.532079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7850dc62-c653-4de3-a6d7-ccf8e858887c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:12.532843 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7850dc62-c653-4de3-a6d7-ccf8e858887c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:12.539503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7850dc62-c653-4de3-a6d7-ccf8e858887c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:12.540178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7850dc62-c653-4de3-a6d7-ccf8e858887c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:12.546352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7850dc62-c653-4de3-a6d7-ccf8e858887c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:12.546352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7850dc62-c653-4de3-a6d7-ccf8e858887c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:12.761753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7850dc62-c653-4de3-a6d7-ccf8e858887c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:12.769305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7850dc62-c653-4de3-a6d7-ccf8e858887c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1271 microversion: 2.1 time: 0.241392 Jul 27 20:17:12.769876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 240/474] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:13.215289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:13.215832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:13.222103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:13.222543 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:13.223285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:13.223710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:13.355535 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:13.363464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:13.365026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:13.366177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c210d62f-6246-44df-8c3d-696c9e659188 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1744 microversion: 2.20 time: 0.155022 Jul 27 20:17:13.367000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 235/475] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:13 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:13.789691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dd14005a-9b72-4f6d-99fc-38fc4ff19653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:13.790319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dd14005a-9b72-4f6d-99fc-38fc4ff19653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:13.797512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd14005a-9b72-4f6d-99fc-38fc4ff19653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:13.797976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd14005a-9b72-4f6d-99fc-38fc4ff19653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:13.798898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd14005a-9b72-4f6d-99fc-38fc4ff19653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:13.799479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd14005a-9b72-4f6d-99fc-38fc4ff19653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:13.941264 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dd14005a-9b72-4f6d-99fc-38fc4ff19653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:13.949153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dd14005a-9b72-4f6d-99fc-38fc4ff19653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1271 microversion: 2.1 time: 0.163543 Jul 27 20:17:13.949716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 241/476] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:14.390048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:14.390664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:14.397195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:14.397669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:14.398426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:14.398854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:14.529214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:14.539681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:14.541748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:14.552088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dfd294a3-641a-44cc-b49b-0ce83bf6a009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1744 microversion: 2.20 time: 0.156806 Jul 27 20:17:14.552088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 236/477] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:14 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:14.969714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d470e290-c5ff-4f8a-a524-5dddbc8965bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:14.970327 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d470e290-c5ff-4f8a-a524-5dddbc8965bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:14.976858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d470e290-c5ff-4f8a-a524-5dddbc8965bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:14.977312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d470e290-c5ff-4f8a-a524-5dddbc8965bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:14.978658 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d470e290-c5ff-4f8a-a524-5dddbc8965bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:14.979131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d470e290-c5ff-4f8a-a524-5dddbc8965bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:15.108256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d470e290-c5ff-4f8a-a524-5dddbc8965bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:15.115665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d470e290-c5ff-4f8a-a524-5dddbc8965bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.149766 Jul 27 20:17:15.116248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 242/478] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:15.566803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:15.567415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:15.574490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:15.574939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:15.575695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:15.576285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:15.705587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:15.713326 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:15.714824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:15.715953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-46cd2843-56e4-48f1-a681-09c029b18841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1744 microversion: 2.20 time: 0.153062 Jul 27 20:17:15.716529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 237/479] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:16.140363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-81beeede-a514-4ff0-bbfa-d62685a040dc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:16.140925 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-81beeede-a514-4ff0-bbfa-d62685a040dc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:16.143344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:16.148176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81beeede-a514-4ff0-bbfa-d62685a040dc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:16.148671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81beeede-a514-4ff0-bbfa-d62685a040dc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:16.149437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81beeede-a514-4ff0-bbfa-d62685a040dc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:16.150515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81beeede-a514-4ff0-bbfa-d62685a040dc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:16.164968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:16.284592 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-81beeede-a514-4ff0-bbfa-d62685a040dc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:16.291850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-81beeede-a514-4ff0-bbfa-d62685a040dc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.155433 Jul 27 20:17:16.292428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 243/480] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:16.738434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:16.739046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:16.741709 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:16.747108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:16.750931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:16.750931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:16.750931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:16.879483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:16.888325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:16.889872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:16.891030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dd4bb9d4-9bde-4e1f-9502-aa50fbc35392 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1744 microversion: 2.20 time: 0.156740 Jul 27 20:17:16.891594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 238/481] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:16 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:17.312594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b6ac4f8d-1d08-4a88-9f1d-0ff1e697764f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:17.313204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b6ac4f8d-1d08-4a88-9f1d-0ff1e697764f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:17.319587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6ac4f8d-1d08-4a88-9f1d-0ff1e697764f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:17.320027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6ac4f8d-1d08-4a88-9f1d-0ff1e697764f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:17.320804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6ac4f8d-1d08-4a88-9f1d-0ff1e697764f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:17.321235 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6ac4f8d-1d08-4a88-9f1d-0ff1e697764f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:17.455147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b6ac4f8d-1d08-4a88-9f1d-0ff1e697764f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:17.463163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b6ac4f8d-1d08-4a88-9f1d-0ff1e697764f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.153837 Jul 27 20:17:17.463735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 244/482] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:17.914510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:17.914939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:17.921473 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:17.921916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:17.922672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:17.923098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:18.052201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:18.060340 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:18.061885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:18.063040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e200bcd3-95fa-400e-9b1f-3e4f0d319870 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1744 microversion: 2.20 time: 0.152564 Jul 27 20:17:18.063604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 239/483] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:18.444588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-71f4975b-f0ea-4ec2-85ca-b867f8736124 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce354c86-9d5a-4cf9-a63a-e239915ff97e"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:17:18.447529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-71f4975b-f0ea-4ec2-85ca-b867f8736124 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:18.453962 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-71f4975b-f0ea-4ec2-85ca-b867f8736124 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:18.454410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-71f4975b-f0ea-4ec2-85ca-b867f8736124 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:18.455163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-71f4975b-f0ea-4ec2-85ca-b867f8736124 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:18.455605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-71f4975b-f0ea-4ec2-85ca-b867f8736124 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:18.483006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c3d8a258-4036-4692-bda4-3eef147a0577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:18.483715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c3d8a258-4036-4692-bda4-3eef147a0577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:18.490320 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3d8a258-4036-4692-bda4-3eef147a0577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:18.490771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3d8a258-4036-4692-bda4-3eef147a0577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:18.491833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3d8a258-4036-4692-bda4-3eef147a0577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:18.492413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3d8a258-4036-4692-bda4-3eef147a0577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:18.633593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c3d8a258-4036-4692-bda4-3eef147a0577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:18.641760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c3d8a258-4036-4692-bda4-3eef147a0577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.162629 Jul 27 20:17:18.642689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 240/484] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:17:18.685289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4a40b0f3-5f60-4472-b67d-3b14d8c9c3ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:18.685775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4a40b0f3-5f60-4472-b67d-3b14d8c9c3ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:18.691762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a40b0f3-5f60-4472-b67d-3b14d8c9c3ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:18.692206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a40b0f3-5f60-4472-b67d-3b14d8c9c3ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:18.692990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a40b0f3-5f60-4472-b67d-3b14d8c9c3ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:18.693423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a40b0f3-5f60-4472-b67d-3b14d8c9c3ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:18.782224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-4a40b0f3-5f60-4472-b67d-3b14d8c9c3ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lazy-loading 'services' on Instance uuid 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:17:19.009698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4a40b0f3-5f60-4472-b67d-3b14d8c9c3ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments/8672d324-9e51-4d4b-a2d4-3fa31e947ccc" status: 202 len: 0 microversion: 2.1 time: 0.328350 Jul 27 20:17:19.011268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 241/485] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:17:18 2022] DELETE /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments/8672d324-9e51-4d4b-a2d4-3fa31e947ccc => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:17:19.087152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:19.087898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:19.095479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:19.095931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:19.096729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:19.097156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:19.238583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:19.247945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:19.249239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:19.250408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5ab183cf-b158-4ee6-980d-862c291d737c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.168051 Jul 27 20:17:19.250967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 242/486] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:19 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:19.306417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-71f4975b-f0ea-4ec2-85ca-b867f8736124 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "POST /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.865106 Jul 27 20:17:19.307037 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 245/487] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:17:18 2022] POST /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce/os-volume_attachments => generated 194 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:17:19.662818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73e81eee-1848-492f-b149-6459a7c6db18 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:19.663577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-73e81eee-1848-492f-b149-6459a7c6db18 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:19.671172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e81eee-1848-492f-b149-6459a7c6db18 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:19.671743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e81eee-1848-492f-b149-6459a7c6db18 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:19.672650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e81eee-1848-492f-b149-6459a7c6db18 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:19.673188 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e81eee-1848-492f-b149-6459a7c6db18 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:19.855935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-73e81eee-1848-492f-b149-6459a7c6db18 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:19.870878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-73e81eee-1848-492f-b149-6459a7c6db18 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.211863 Jul 27 20:17:19.871465 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 243/488] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:20.036608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-31880e06-c43d-448f-8873-f58718621d9d req-4b8d82a6-f01a-4f1b-9d27-25a1a4810352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0929536d-2d91-4e59-8f36-474025d921ef", "name": "network-vif-plugged", "status": "completed", "tag": "39cce058-68c6-4a18-8354-201c5dba75c7"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:17:20.047178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:20.052819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-31880e06-c43d-448f-8873-f58718621d9d req-4b8d82a6-f01a-4f1b-9d27-25a1a4810352 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:20.053557 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-31880e06-c43d-448f-8873-f58718621d9d req-4b8d82a6-f01a-4f1b-9d27-25a1a4810352 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:20.065973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-31880e06-c43d-448f-8873-f58718621d9d req-4b8d82a6-f01a-4f1b-9d27-25a1a4810352 service nova] Creating event network-vif-plugged:39cce058-68c6-4a18-8354-201c5dba75c7 for instance 0929536d-2d91-4e59-8f36-474025d921ef on hv-cinder-85124 Jul 27 20:17:20.071790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-31880e06-c43d-448f-8873-f58718621d9d req-4b8d82a6-f01a-4f1b-9d27-25a1a4810352 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040110 Jul 27 20:17:20.073019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 246/489] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:17:20.273903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:20.275639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:20.281684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=63 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:20.284521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:20.285493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:20.287089 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:20.287526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:20.444193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:20.460621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:20.462743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:20.463913 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3fd7a060-7ad7-431a-8690-f80ef69edb21 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.194121 Jul 27 20:17:20.473464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 244/490] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:20 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:20.892403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2f6b9df0-68a6-4a6f-a550-952b37e92097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:20.893094 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2f6b9df0-68a6-4a6f-a550-952b37e92097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:20.902894 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f6b9df0-68a6-4a6f-a550-952b37e92097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:20.903585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f6b9df0-68a6-4a6f-a550-952b37e92097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:20.904587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f6b9df0-68a6-4a6f-a550-952b37e92097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:20.905200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f6b9df0-68a6-4a6f-a550-952b37e92097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:21.049599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2f6b9df0-68a6-4a6f-a550-952b37e92097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:21.060572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2f6b9df0-68a6-4a6f-a550-952b37e92097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.172692 Jul 27 20:17:21.061152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 247/491] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:21.489744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:21.491576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:21.525031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:21.525031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:21.525031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:21.525031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:21.807496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:21.816797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:21.818641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:21.820267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f181348c-2126-47eb-8079-fbdea2abc06f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.335403 Jul 27 20:17:21.836706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 245/492] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:22.085662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6678c301-6b41-4973-aa9a-163a5363a1a7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:22.087968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6678c301-6b41-4973-aa9a-163a5363a1a7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:22.107496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6678c301-6b41-4973-aa9a-163a5363a1a7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:22.107951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6678c301-6b41-4973-aa9a-163a5363a1a7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:22.108821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6678c301-6b41-4973-aa9a-163a5363a1a7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:22.109248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6678c301-6b41-4973-aa9a-163a5363a1a7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:22.337482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6678c301-6b41-4973-aa9a-163a5363a1a7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:22.346348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6678c301-6b41-4973-aa9a-163a5363a1a7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.265920 Jul 27 20:17:22.347124 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 248/493] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:22.854425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:22.855774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:22.862675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:22.863113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:22.863871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:22.864294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:23.018542 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:23.022258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:23.030373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:23.032054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:23.033239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-832d318f-336d-4d10-90ec-b5fd6c45275b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.182812 Jul 27 20:17:23.033986 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 246/494] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:23.371229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-93f4a782-7caf-4f55-a741-37d91f090391 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:23.371821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-93f4a782-7caf-4f55-a741-37d91f090391 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:23.378820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93f4a782-7caf-4f55-a741-37d91f090391 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:23.379756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93f4a782-7caf-4f55-a741-37d91f090391 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:23.380783 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93f4a782-7caf-4f55-a741-37d91f090391 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:23.381215 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93f4a782-7caf-4f55-a741-37d91f090391 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:23.541204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-93f4a782-7caf-4f55-a741-37d91f090391 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:23.549224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-93f4a782-7caf-4f55-a741-37d91f090391 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.182650 Jul 27 20:17:23.550069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 249/495] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:24.060444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:24.061204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:24.069534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:24.069973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:24.070728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:24.071182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:24.216945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:24.226459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:24.228259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:24.229520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-74e1af07-2870-448a-b1b1-7cc743184a60 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.173026 Jul 27 20:17:24.231868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 247/496] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:24 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:24.576305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b25c9aee-e536-49d6-ab1c-6e18b7dd2750 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:24.577733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b25c9aee-e536-49d6-ab1c-6e18b7dd2750 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:24.584224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b25c9aee-e536-49d6-ab1c-6e18b7dd2750 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:24.584913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b25c9aee-e536-49d6-ab1c-6e18b7dd2750 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:24.585710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b25c9aee-e536-49d6-ab1c-6e18b7dd2750 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:24.587190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b25c9aee-e536-49d6-ab1c-6e18b7dd2750 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:24.737747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b25c9aee-e536-49d6-ab1c-6e18b7dd2750 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:24.747342 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b25c9aee-e536-49d6-ab1c-6e18b7dd2750 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.174941 Jul 27 20:17:24.748241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 250/497] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:25.253193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:25.273466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:25.273466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:25.273466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:25.273466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:25.273864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:25.407966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:25.416050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:25.417582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:25.418729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9cb1a9f9-67c3-4b36-820d-fea74edb1a90 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.169730 Jul 27 20:17:25.419295 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 248/498] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:25 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:25.768871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e63ee50d-2447-4d9a-b37c-4cc751a41e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:25.769480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e63ee50d-2447-4d9a-b37c-4cc751a41e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:25.779893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e63ee50d-2447-4d9a-b37c-4cc751a41e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:25.780611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e63ee50d-2447-4d9a-b37c-4cc751a41e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:25.781848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e63ee50d-2447-4d9a-b37c-4cc751a41e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:25.782444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e63ee50d-2447-4d9a-b37c-4cc751a41e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:25.930723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e63ee50d-2447-4d9a-b37c-4cc751a41e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:25.941610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e63ee50d-2447-4d9a-b37c-4cc751a41e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.176827 Jul 27 20:17:25.942187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 251/499] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:26.441689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:26.443345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:26.450302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:26.450752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:26.451707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:26.452137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:26.602043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:26.612344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:26.614353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:26.615714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ed9f081d-7fcb-4a26-82a4-842fbf430d4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.177946 Jul 27 20:17:26.632406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 249/500] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:26 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:26.963418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-888b8391-cdd8-4843-ad50-f95bafeb57bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:26.965257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-888b8391-cdd8-4843-ad50-f95bafeb57bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:26.974223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-888b8391-cdd8-4843-ad50-f95bafeb57bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:26.974672 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-888b8391-cdd8-4843-ad50-f95bafeb57bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:26.975444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-888b8391-cdd8-4843-ad50-f95bafeb57bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:26.975913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-888b8391-cdd8-4843-ad50-f95bafeb57bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:27.124901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-888b8391-cdd8-4843-ad50-f95bafeb57bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:27.132455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-888b8391-cdd8-4843-ad50-f95bafeb57bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.173753 Jul 27 20:17:27.133038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 252/501] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:27.640512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:27.641131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:27.650885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:27.651577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:27.652550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:27.653161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:27.817442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:27.828682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:27.830637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:27.831994 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fb408836-68b1-41ce-a5cc-92379dca48fc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.195277 Jul 27 20:17:27.833091 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 250/502] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:27 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:28.153663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a04ec04b-9d6f-49c5-bb70-c92d5e1765e8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:28.154292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a04ec04b-9d6f-49c5-bb70-c92d5e1765e8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:28.161191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a04ec04b-9d6f-49c5-bb70-c92d5e1765e8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:28.161653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a04ec04b-9d6f-49c5-bb70-c92d5e1765e8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:28.162435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a04ec04b-9d6f-49c5-bb70-c92d5e1765e8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:28.162874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a04ec04b-9d6f-49c5-bb70-c92d5e1765e8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:28.305994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a04ec04b-9d6f-49c5-bb70-c92d5e1765e8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:28.313915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a04ec04b-9d6f-49c5-bb70-c92d5e1765e8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.164777 Jul 27 20:17:28.315257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 253/503] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:28.855270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:28.855879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:28.862531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:28.863033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:28.863780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:28.864248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:29.032123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:29.042226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:29.044558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:29.046114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e3f11616-75b0-4222-a0a3-57010641784e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.194921 Jul 27 20:17:29.047097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 251/504] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:28 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:29.335604 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-51fa7161-fc7e-4658-8a3b-530ff24c71eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:29.339073 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-51fa7161-fc7e-4658-8a3b-530ff24c71eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:29.345368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51fa7161-fc7e-4658-8a3b-530ff24c71eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:29.345889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51fa7161-fc7e-4658-8a3b-530ff24c71eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:29.346786 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51fa7161-fc7e-4658-8a3b-530ff24c71eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:29.347282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51fa7161-fc7e-4658-8a3b-530ff24c71eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:29.370030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:29.513337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-51fa7161-fc7e-4658-8a3b-530ff24c71eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:29.513337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-51fa7161-fc7e-4658-8a3b-530ff24c71eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.175990 Jul 27 20:17:29.513337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 254/505] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:30.075872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:30.076421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:30.082943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:30.083391 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:30.084146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:30.084608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:30.221608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:30.229450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:30.230978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:30.232108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-23e334c1-3ba7-4483-9cd5-24c943fe3c5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.160315 Jul 27 20:17:30.232695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 252/506] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:30.529219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-08d938e0-b84c-409d-bdc2-99a1fe9be8bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:30.529828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-08d938e0-b84c-409d-bdc2-99a1fe9be8bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:30.536862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-08d938e0-b84c-409d-bdc2-99a1fe9be8bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:30.537743 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-08d938e0-b84c-409d-bdc2-99a1fe9be8bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:30.538564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-08d938e0-b84c-409d-bdc2-99a1fe9be8bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:30.539003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-08d938e0-b84c-409d-bdc2-99a1fe9be8bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:30.666790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-08d938e0-b84c-409d-bdc2-99a1fe9be8bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:30.674140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-08d938e0-b84c-409d-bdc2-99a1fe9be8bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.149748 Jul 27 20:17:30.674712 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 255/507] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:31.254551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:31.255148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:31.261468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:31.261906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:31.262649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:31.263072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:31.391182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:31.401531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:31.403113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:31.404274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-32f80fd8-31d1-4f6c-9971-91a107785db1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.153529 Jul 27 20:17:31.404859 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 253/508] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:31 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:31.695192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-36b3834e-2ad7-4296-a905-c9564f88e09d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:31.696324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-36b3834e-2ad7-4296-a905-c9564f88e09d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:31.702769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-36b3834e-2ad7-4296-a905-c9564f88e09d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:31.703210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-36b3834e-2ad7-4296-a905-c9564f88e09d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:31.703949 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-36b3834e-2ad7-4296-a905-c9564f88e09d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:31.704387 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-36b3834e-2ad7-4296-a905-c9564f88e09d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:31.833783 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-36b3834e-2ad7-4296-a905-c9564f88e09d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:31.842337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-36b3834e-2ad7-4296-a905-c9564f88e09d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.150927 Jul 27 20:17:31.842926 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 256/509] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:32.427208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:32.427832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:32.434520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:32.434976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:32.435772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:32.436206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:32.562054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:32.570091 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:32.573363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:32.574513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-92c0fd5d-57e3-4687-a58c-e5f13f1d2a5a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.151277 Jul 27 20:17:32.575106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 254/510] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:32 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:32.863078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aef5a98e-8599-40be-8828-ca3d2491bf48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:32.863700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aef5a98e-8599-40be-8828-ca3d2491bf48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:32.870957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aef5a98e-8599-40be-8828-ca3d2491bf48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:32.871405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aef5a98e-8599-40be-8828-ca3d2491bf48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:32.872168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aef5a98e-8599-40be-8828-ca3d2491bf48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:32.872632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aef5a98e-8599-40be-8828-ca3d2491bf48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:33.009582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aef5a98e-8599-40be-8828-ca3d2491bf48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:33.017021 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aef5a98e-8599-40be-8828-ca3d2491bf48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.158118 Jul 27 20:17:33.017585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 257/511] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:33.598031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:33.598561 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:33.605669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:33.606120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:33.606874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:33.607310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:33.733079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:33.740838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:33.743102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:33.744244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-294c6796-1bb5-4ac0-9e6b-8823c2d2ba23 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.150234 Jul 27 20:17:33.744847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 255/512] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:33 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:34.038031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6abe813a-60ba-4e3a-9574-dc900307d729 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:34.038634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6abe813a-60ba-4e3a-9574-dc900307d729 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:34.045569 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6abe813a-60ba-4e3a-9574-dc900307d729 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:34.046013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6abe813a-60ba-4e3a-9574-dc900307d729 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:34.046790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6abe813a-60ba-4e3a-9574-dc900307d729 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:34.047249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6abe813a-60ba-4e3a-9574-dc900307d729 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:34.179515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6abe813a-60ba-4e3a-9574-dc900307d729 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:34.187478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6abe813a-60ba-4e3a-9574-dc900307d729 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.153409 Jul 27 20:17:34.188046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 258/513] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:34.767717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:34.768236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:34.774643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:34.775085 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:34.775834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:34.776262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:34.899779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:34.907532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:34.909078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:34.910257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d82ea700-a269-4f94-b928-847b58015438 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.146480 Jul 27 20:17:34.910815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 256/514] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:35.208277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-95caf0f7-b307-4d82-b5ff-ba964a731bfb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:35.208949 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-95caf0f7-b307-4d82-b5ff-ba964a731bfb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:35.216240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-95caf0f7-b307-4d82-b5ff-ba964a731bfb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:35.221249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-95caf0f7-b307-4d82-b5ff-ba964a731bfb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:35.221249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-95caf0f7-b307-4d82-b5ff-ba964a731bfb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:35.221249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-95caf0f7-b307-4d82-b5ff-ba964a731bfb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:35.347414 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-95caf0f7-b307-4d82-b5ff-ba964a731bfb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:35.355391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-95caf0f7-b307-4d82-b5ff-ba964a731bfb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.150979 Jul 27 20:17:35.355957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 259/515] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:35 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:35.932784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:35.933394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:35.939873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:35.940324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:35.941124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:35.941556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:36.073328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:36.082400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:36.083067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:36.084203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-741d4b06-84b8-4d67-852c-4f5f8d764379 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.155422 Jul 27 20:17:36.084786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 257/516] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:35 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:36.376160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-04998e39-6e5c-45d5-9d9e-5054c92f24b6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:36.376813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-04998e39-6e5c-45d5-9d9e-5054c92f24b6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:36.383856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04998e39-6e5c-45d5-9d9e-5054c92f24b6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:36.384298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04998e39-6e5c-45d5-9d9e-5054c92f24b6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:36.385072 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04998e39-6e5c-45d5-9d9e-5054c92f24b6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:36.385499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04998e39-6e5c-45d5-9d9e-5054c92f24b6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:36.517635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-04998e39-6e5c-45d5-9d9e-5054c92f24b6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:36.525869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-04998e39-6e5c-45d5-9d9e-5054c92f24b6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.153528 Jul 27 20:17:36.526470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 260/517] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:37.108080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:37.108736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:37.115065 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:37.115511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:37.116557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:37.116988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:37.250469 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:37.258217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:37.259716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:37.260888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-af1e6605-ae79-4a7d-b04c-f212c7012f7a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.156686 Jul 27 20:17:37.261447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 258/518] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:37.546743 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-780d6081-ccc8-497c-b221-0777286793f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:37.547365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-780d6081-ccc8-497c-b221-0777286793f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:37.553997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-780d6081-ccc8-497c-b221-0777286793f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:37.554449 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-780d6081-ccc8-497c-b221-0777286793f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:37.555257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-780d6081-ccc8-497c-b221-0777286793f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:37.555700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-780d6081-ccc8-497c-b221-0777286793f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:37.682486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-780d6081-ccc8-497c-b221-0777286793f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:37.689999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-780d6081-ccc8-497c-b221-0777286793f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.147243 Jul 27 20:17:37.690565 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 261/519] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:38.283031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:38.283636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:38.289759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:38.290201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:38.290945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:38.291371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:38.421505 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:38.429650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:38.431789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:38.433021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9aeaa513-ddfe-427b-914a-2d9f33341062 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.153854 Jul 27 20:17:38.433574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 259/520] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:38 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:38.710843 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f0e01ea0-3059-42a5-8ab4-f07b6f9f9191 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:38.711440 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f0e01ea0-3059-42a5-8ab4-f07b6f9f9191 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:38.717855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0e01ea0-3059-42a5-8ab4-f07b6f9f9191 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:38.718297 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0e01ea0-3059-42a5-8ab4-f07b6f9f9191 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:38.719038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0e01ea0-3059-42a5-8ab4-f07b6f9f9191 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:38.719462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0e01ea0-3059-42a5-8ab4-f07b6f9f9191 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:38.852170 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f0e01ea0-3059-42a5-8ab4-f07b6f9f9191 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:38.859533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f0e01ea0-3059-42a5-8ab4-f07b6f9f9191 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.152541 Jul 27 20:17:38.860092 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 262/521] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:39.455167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:39.455770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:39.462263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:39.463263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:39.464023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:39.464488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:39.592957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:39.600936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:39.602458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:39.603635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2d733735-1aaa-474a-8765-42436c5dcd8b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.152406 Jul 27 20:17:39.604202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 260/522] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:39 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:39.880117 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-497dc6cf-851d-476f-bb7f-571f3bfc57c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:39.880688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-497dc6cf-851d-476f-bb7f-571f3bfc57c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:39.887803 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-497dc6cf-851d-476f-bb7f-571f3bfc57c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:39.888242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-497dc6cf-851d-476f-bb7f-571f3bfc57c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:39.889031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-497dc6cf-851d-476f-bb7f-571f3bfc57c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:39.889456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-497dc6cf-851d-476f-bb7f-571f3bfc57c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:40.020800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-497dc6cf-851d-476f-bb7f-571f3bfc57c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:40.028194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-497dc6cf-851d-476f-bb7f-571f3bfc57c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.151938 Jul 27 20:17:40.028793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 263/523] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:40.627160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:40.627707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:40.634075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:40.635139 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:40.635883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:40.636305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:40.762758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:40.770505 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:40.772003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:40.773169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a852e43f-aaf9-4b35-abb6-9ebda7856216 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.150002 Jul 27 20:17:40.773730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 261/524] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:41.049499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-90568cef-2bbd-4955-9dc5-83abb8a9e7b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:41.050134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-90568cef-2bbd-4955-9dc5-83abb8a9e7b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:41.057186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90568cef-2bbd-4955-9dc5-83abb8a9e7b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:41.057635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90568cef-2bbd-4955-9dc5-83abb8a9e7b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:41.058385 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90568cef-2bbd-4955-9dc5-83abb8a9e7b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:41.058819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90568cef-2bbd-4955-9dc5-83abb8a9e7b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:41.190479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90568cef-2bbd-4955-9dc5-83abb8a9e7b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:41.198471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-90568cef-2bbd-4955-9dc5-83abb8a9e7b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.152805 Jul 27 20:17:41.199036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 264/525] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:41 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:41.796782 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:41.797382 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:41.803868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:41.804306 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:41.805080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:41.805506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:41.931789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:41.939511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:41.941066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:41.942197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf4f4772-4f55-438f-a7b0-b63d336003ee tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.149306 Jul 27 20:17:41.942753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 262/526] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:41 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:42.218457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-80028576-7d3c-45a7-a20f-309f9744b0d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:42.219054 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-80028576-7d3c-45a7-a20f-309f9744b0d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:42.225403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80028576-7d3c-45a7-a20f-309f9744b0d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:42.225846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80028576-7d3c-45a7-a20f-309f9744b0d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:42.226585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80028576-7d3c-45a7-a20f-309f9744b0d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:42.227009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80028576-7d3c-45a7-a20f-309f9744b0d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:42.354506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-80028576-7d3c-45a7-a20f-309f9744b0d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:42.361909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-80028576-7d3c-45a7-a20f-309f9744b0d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.147302 Jul 27 20:17:42.362836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 265/527] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:42.964604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:42.965226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:42.971742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:42.972185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:42.972962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:42.973388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:42.991489 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:43.106970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:43.114946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:43.116821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:43.117973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-172dd31a-3519-407e-90ef-6f9c417f2261 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.157315 Jul 27 20:17:43.119152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 263/528] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:43.383230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4670a8b8-d216-4cda-a13c-e2c73b57bc42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:43.383842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4670a8b8-d216-4cda-a13c-e2c73b57bc42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:43.390390 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4670a8b8-d216-4cda-a13c-e2c73b57bc42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:43.390840 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4670a8b8-d216-4cda-a13c-e2c73b57bc42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:43.391598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4670a8b8-d216-4cda-a13c-e2c73b57bc42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:43.392033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4670a8b8-d216-4cda-a13c-e2c73b57bc42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:43.517607 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4670a8b8-d216-4cda-a13c-e2c73b57bc42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:43.525507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4670a8b8-d216-4cda-a13c-e2c73b57bc42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.145699 Jul 27 20:17:43.526077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 266/529] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:43 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:44.141617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:44.142162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:44.148572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:44.149019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:44.149812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:44.150265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:44.281237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:44.289061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:44.290615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:44.291829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d9458126-4b7c-4117-bfad-0db4e88a31c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.154243 Jul 27 20:17:44.292465 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 264/530] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:44.545977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d099e35a-2703-4bb5-b1a7-b7187b50fdda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:44.546594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d099e35a-2703-4bb5-b1a7-b7187b50fdda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:44.553098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d099e35a-2703-4bb5-b1a7-b7187b50fdda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:44.553545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d099e35a-2703-4bb5-b1a7-b7187b50fdda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:44.554299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d099e35a-2703-4bb5-b1a7-b7187b50fdda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:44.554734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d099e35a-2703-4bb5-b1a7-b7187b50fdda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:44.685149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d099e35a-2703-4bb5-b1a7-b7187b50fdda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:44.692526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d099e35a-2703-4bb5-b1a7-b7187b50fdda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.150375 Jul 27 20:17:44.693095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 267/531] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:45.314841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:45.315446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:45.322443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:45.322889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:45.323638 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:45.324070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:45.454593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:45.463177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:45.464744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:45.465891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f6c7712d-d4f3-4ef4-bff3-20585c177b2a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.155004 Jul 27 20:17:45.466454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 265/532] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:45 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:45.713628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-af17eb68-c5f4-48d3-8cc4-96c747fdc72b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:45.714181 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-af17eb68-c5f4-48d3-8cc4-96c747fdc72b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:45.720600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af17eb68-c5f4-48d3-8cc4-96c747fdc72b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:45.721053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af17eb68-c5f4-48d3-8cc4-96c747fdc72b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:45.721808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af17eb68-c5f4-48d3-8cc4-96c747fdc72b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:45.722243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af17eb68-c5f4-48d3-8cc4-96c747fdc72b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:45.854359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-af17eb68-c5f4-48d3-8cc4-96c747fdc72b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:45.863346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-af17eb68-c5f4-48d3-8cc4-96c747fdc72b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.153241 Jul 27 20:17:45.864206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 268/533] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:46.488890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:46.489500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:46.496220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:46.501008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:46.501008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:46.501008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:46.623759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:46.631861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:46.633393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:46.635187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-be88ff8c-68d2-47d9-9fde-6bf5cbb1ca34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.150131 Jul 27 20:17:46.635754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 266/534] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:46 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:46.890193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eb1266e4-7a02-400d-8ef0-7b1400e433a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:46.890800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eb1266e4-7a02-400d-8ef0-7b1400e433a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:46.897475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb1266e4-7a02-400d-8ef0-7b1400e433a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:46.897919 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb1266e4-7a02-400d-8ef0-7b1400e433a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:46.898668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb1266e4-7a02-400d-8ef0-7b1400e433a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:46.899098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb1266e4-7a02-400d-8ef0-7b1400e433a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:47.029364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb1266e4-7a02-400d-8ef0-7b1400e433a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:47.037018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eb1266e4-7a02-400d-8ef0-7b1400e433a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.150639 Jul 27 20:17:47.037594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 269/535] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:47.658552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:47.659084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:47.665646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:47.666103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:47.666859 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:47.667294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:47.793514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:47.801504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:47.803095 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:47.804260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1b281548-108b-496b-992c-c9b6bb13e221 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.149775 Jul 27 20:17:47.804833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 267/536] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:48.057294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9d93b1f5-9750-473f-bb60-f8479f68290d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:48.057909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9d93b1f5-9750-473f-bb60-f8479f68290d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:48.064542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9d93b1f5-9750-473f-bb60-f8479f68290d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:48.064992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9d93b1f5-9750-473f-bb60-f8479f68290d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:48.065746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9d93b1f5-9750-473f-bb60-f8479f68290d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:48.066326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9d93b1f5-9750-473f-bb60-f8479f68290d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:48.195700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9d93b1f5-9750-473f-bb60-f8479f68290d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:48.203629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9d93b1f5-9750-473f-bb60-f8479f68290d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.150208 Jul 27 20:17:48.204195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 270/537] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:48 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:48.827405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:48.828026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:48.834264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:48.834716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:48.835476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:48.835912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:48.967161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:48.975272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:48.976807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:48.978458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8fec8306-eca8-4c9b-ad97-0197cd8722c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.154893 Jul 27 20:17:48.979045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 268/538] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:48 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:49.224956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0d15de57-9fb9-468e-b1c8-880633fc699a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:49.225580 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0d15de57-9fb9-468e-b1c8-880633fc699a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:49.232609 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0d15de57-9fb9-468e-b1c8-880633fc699a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:49.233066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0d15de57-9fb9-468e-b1c8-880633fc699a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:49.233819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0d15de57-9fb9-468e-b1c8-880633fc699a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:49.234257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0d15de57-9fb9-468e-b1c8-880633fc699a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:49.238205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:49.364451 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0d15de57-9fb9-468e-b1c8-880633fc699a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:49.372179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0d15de57-9fb9-468e-b1c8-880633fc699a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.150969 Jul 27 20:17:49.372731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 271/539] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:50.001855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:50.002469 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:50.009518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:50.010001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:50.010757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:50.011192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:50.380049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:50.388672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:50.390202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:50.391367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b919270f-8d35-4acd-bfc8-c072ee59c2e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.393397 Jul 27 20:17:50.391926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 269/540] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:50.392455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f3d5c94-28ca-4507-9be2-107b9fae963d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:50.393060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6f3d5c94-28ca-4507-9be2-107b9fae963d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:50.399546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f3d5c94-28ca-4507-9be2-107b9fae963d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:50.399990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f3d5c94-28ca-4507-9be2-107b9fae963d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:50.400774 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f3d5c94-28ca-4507-9be2-107b9fae963d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:50.401202 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f3d5c94-28ca-4507-9be2-107b9fae963d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:50.527667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6f3d5c94-28ca-4507-9be2-107b9fae963d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:50.535055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6f3d5c94-28ca-4507-9be2-107b9fae963d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.146516 Jul 27 20:17:50.535629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 272/541] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:17:51.413871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:51.414483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:51.416815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=52 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:51.421554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:51.422004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:51.422763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:51.423198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:51.550363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:51.555366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2aad630a-8336-48de-82cf-d391fcfcf987 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:51.556684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2aad630a-8336-48de-82cf-d391fcfcf987 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:51.558872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:51.559044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=54 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:51.560418 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:51.561744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-045759ae-04ef-4ea6-95ca-91b7045a901a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.151705 Jul 27 20:17:51.562483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 270/542] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:51.564143 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2aad630a-8336-48de-82cf-d391fcfcf987 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:51.564631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2aad630a-8336-48de-82cf-d391fcfcf987 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:51.565400 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2aad630a-8336-48de-82cf-d391fcfcf987 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:51.571761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2aad630a-8336-48de-82cf-d391fcfcf987 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:51.694936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2aad630a-8336-48de-82cf-d391fcfcf987 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:51.702880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2aad630a-8336-48de-82cf-d391fcfcf987 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.151761 Jul 27 20:17:51.703449 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 273/543] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:17:52.585051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:52.585583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:52.592491 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:52.592936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:52.593693 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:52.594122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:52.724558 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-001831ce-5e23-42e5-928a-6b711c2f5808 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:52.725167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-001831ce-5e23-42e5-928a-6b711c2f5808 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:52.725912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:52.733954 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-001831ce-5e23-42e5-928a-6b711c2f5808 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:52.734323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:52.734449 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-001831ce-5e23-42e5-928a-6b711c2f5808 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:52.735131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-001831ce-5e23-42e5-928a-6b711c2f5808 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:52.735557 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-001831ce-5e23-42e5-928a-6b711c2f5808 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:52.735834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:52.737129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-47da87f3-f949-4a57-b2b1-6c7266c025e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.155896 Jul 27 20:17:52.740434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 271/544] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:52 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:52.864673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-001831ce-5e23-42e5-928a-6b711c2f5808 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:52.872247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-001831ce-5e23-42e5-928a-6b711c2f5808 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.151608 Jul 27 20:17:52.872830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 274/545] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:17:53.760979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:53.761590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:53.768110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:53.768594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:53.769355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:53.769785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:53.893052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-321deb55-516d-451d-94d4-335d07739a38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:53.893668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-321deb55-516d-451d-94d4-335d07739a38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:53.899717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:53.900988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-321deb55-516d-451d-94d4-335d07739a38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:53.901478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-321deb55-516d-451d-94d4-335d07739a38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:53.902250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-321deb55-516d-451d-94d4-335d07739a38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:53.902687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-321deb55-516d-451d-94d4-335d07739a38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:53.907833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:53.909389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:53.910549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7ce15f93-f0e4-4796-b442-af04126475e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.154003 Jul 27 20:17:53.911105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 272/546] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:53 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:54.034707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-321deb55-516d-451d-94d4-335d07739a38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:54.042638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-321deb55-516d-451d-94d4-335d07739a38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.153452 Jul 27 20:17:54.043201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 275/547] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:17:54.934461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:54.935068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:54.941292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:54.941738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:54.942500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:54.942929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:55.063149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-241c721a-6bdd-4067-8201-cc5a9d2fd585 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:55.063726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-241c721a-6bdd-4067-8201-cc5a9d2fd585 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:55.068754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:55.070745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-241c721a-6bdd-4067-8201-cc5a9d2fd585 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:55.071738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-241c721a-6bdd-4067-8201-cc5a9d2fd585 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:55.072541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-241c721a-6bdd-4067-8201-cc5a9d2fd585 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:55.073008 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-241c721a-6bdd-4067-8201-cc5a9d2fd585 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:55.077453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:55.098293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:55.098293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d8586231-cc7c-45bc-9dfc-8d3166234c51 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.150185 Jul 27 20:17:55.098293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 273/548] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:54 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:55.216914 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-241c721a-6bdd-4067-8201-cc5a9d2fd585 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:55.221215 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-241c721a-6bdd-4067-8201-cc5a9d2fd585 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.162078 Jul 27 20:17:55.221788 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 276/549] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:17:56.104221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:56.104766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:56.111182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:56.111621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:56.112362 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:56.112807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:56.242116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e1f0a86d-9bab-4ff6-86c4-0cea09979f3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:56.243210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e1f0a86d-9bab-4ff6-86c4-0cea09979f3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:56.250508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:56.251145 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1f0a86d-9bab-4ff6-86c4-0cea09979f3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:56.251145 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1f0a86d-9bab-4ff6-86c4-0cea09979f3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:56.251774 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1f0a86d-9bab-4ff6-86c4-0cea09979f3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:56.252288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1f0a86d-9bab-4ff6-86c4-0cea09979f3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:56.259004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:56.260883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:56.262148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6adf67e3-30f4-4003-9745-c7b8243ac087 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.161829 Jul 27 20:17:56.263781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 274/550] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:56.390994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e1f0a86d-9bab-4ff6-86c4-0cea09979f3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:56.398483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e1f0a86d-9bab-4ff6-86c4-0cea09979f3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.160470 Jul 27 20:17:56.399054 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 277/551] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:17:57.284741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:57.285360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:57.291710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:57.292159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:57.292962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:57.293399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:57.419146 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-96f587b4-c0c8-49e8-a227-a7329fca6bbc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:57.419609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:57.419914 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-96f587b4-c0c8-49e8-a227-a7329fca6bbc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:57.426531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96f587b4-c0c8-49e8-a227-a7329fca6bbc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:57.426984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96f587b4-c0c8-49e8-a227-a7329fca6bbc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:57.427742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96f587b4-c0c8-49e8-a227-a7329fca6bbc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:57.427905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:57.428177 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96f587b4-c0c8-49e8-a227-a7329fca6bbc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:57.429456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:57.430835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6c1cde29-df44-4110-8473-0ce4fe960c6c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.149983 Jul 27 20:17:57.431415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 275/552] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:57.556123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-96f587b4-c0c8-49e8-a227-a7329fca6bbc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:57.563572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-96f587b4-c0c8-49e8-a227-a7329fca6bbc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.148453 Jul 27 20:17:57.564153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 278/553] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:17:58.455612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:58.456232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:58.463338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:58.463781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:58.464623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:58.465054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:58.584922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3ed9dfcb-f709-4fd1-81b2-1e35f542b016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:58.585554 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3ed9dfcb-f709-4fd1-81b2-1e35f542b016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:58.592769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ed9dfcb-f709-4fd1-81b2-1e35f542b016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:58.593224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ed9dfcb-f709-4fd1-81b2-1e35f542b016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:58.593995 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ed9dfcb-f709-4fd1-81b2-1e35f542b016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:58.594240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:58.594433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ed9dfcb-f709-4fd1-81b2-1e35f542b016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:58.602790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:58.604310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:58.605490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-88bbc81c-4975-45ad-9652-3113ee53ee5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.153754 Jul 27 20:17:58.606054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 276/554] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:58 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:58.723639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3ed9dfcb-f709-4fd1-81b2-1e35f542b016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:58.731690 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3ed9dfcb-f709-4fd1-81b2-1e35f542b016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.150821 Jul 27 20:17:58.732256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 279/555] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:17:59.628884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:59.629496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:59.636582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:59.636914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:59.637663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:59.638095 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:59.754311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9b34e85d-12c6-4bd1-bcff-215b0059e89f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:59.754913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9b34e85d-12c6-4bd1-bcff-215b0059e89f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:59.764203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9b34e85d-12c6-4bd1-bcff-215b0059e89f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:59.764673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9b34e85d-12c6-4bd1-bcff-215b0059e89f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:59.765444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9b34e85d-12c6-4bd1-bcff-215b0059e89f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:59.766082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9b34e85d-12c6-4bd1-bcff-215b0059e89f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:59.771282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:59.779992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:59.781578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:59.782745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-12a0f3a8-e493-4507-900f-51c3e7e5d93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.157720 Jul 27 20:17:59.783591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 277/556] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:17:59 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:17:59.903039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9b34e85d-12c6-4bd1-bcff-215b0059e89f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:17:59.910567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9b34e85d-12c6-4bd1-bcff-215b0059e89f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.160044 Jul 27 20:17:59.911122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 280/557] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:17:59 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:00.807414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:00.808008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:00.814354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:00.814796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:00.815550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:00.815963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:00.931770 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bcf80cf9-58b0-4b2d-bad3-81dde9e7bfa1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:00.932412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bcf80cf9-58b0-4b2d-bad3-81dde9e7bfa1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:00.938795 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bcf80cf9-58b0-4b2d-bad3-81dde9e7bfa1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:00.939246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bcf80cf9-58b0-4b2d-bad3-81dde9e7bfa1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:00.940004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bcf80cf9-58b0-4b2d-bad3-81dde9e7bfa1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:00.940464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bcf80cf9-58b0-4b2d-bad3-81dde9e7bfa1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:00.943687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:00.951645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:00.953193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:00.954356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f29c9ea1-ccce-4aa9-9f71-401e038a743e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.151253 Jul 27 20:18:00.954921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 278/558] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:00 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:01.071640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bcf80cf9-58b0-4b2d-bad3-81dde9e7bfa1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:01.078982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bcf80cf9-58b0-4b2d-bad3-81dde9e7bfa1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.151883 Jul 27 20:18:01.079542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 281/559] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:01.977144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:01.977767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:01.984723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:01.985173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:01.985936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:01.986370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:02.098916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aad4f00d-5906-41e1-9875-54c77448fe0c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:02.099537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aad4f00d-5906-41e1-9875-54c77448fe0c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:02.106137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad4f00d-5906-41e1-9875-54c77448fe0c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:02.106589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad4f00d-5906-41e1-9875-54c77448fe0c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:02.107358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad4f00d-5906-41e1-9875-54c77448fe0c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:02.107796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad4f00d-5906-41e1-9875-54c77448fe0c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:02.112844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:02.121453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:02.122965 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:02.124112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1de2f79f-517f-4103-8353-aa55555093a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.151059 Jul 27 20:18:02.124718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 279/560] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:02.238629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aad4f00d-5906-41e1-9875-54c77448fe0c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:02.246875 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aad4f00d-5906-41e1-9875-54c77448fe0c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.151772 Jul 27 20:18:02.247448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 282/561] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:02 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:03.147252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:03.147768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:03.154933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:03.155377 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:03.156133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:03.156613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:03.160574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:03.266935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6da547dc-2f17-4a5b-beea-31f50a29aa48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:03.267585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6da547dc-2f17-4a5b-beea-31f50a29aa48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:03.274592 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6da547dc-2f17-4a5b-beea-31f50a29aa48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:03.275041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6da547dc-2f17-4a5b-beea-31f50a29aa48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:03.275805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6da547dc-2f17-4a5b-beea-31f50a29aa48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:03.276244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6da547dc-2f17-4a5b-beea-31f50a29aa48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:03.284338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:03.292181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:03.293761 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:03.294909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f4a02391-aedc-478e-bae8-497b500d9ad2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.151716 Jul 27 20:18:03.295472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 280/562] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:03.409570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6da547dc-2f17-4a5b-beea-31f50a29aa48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:03.417085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6da547dc-2f17-4a5b-beea-31f50a29aa48 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.153985 Jul 27 20:18:03.417655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 283/563] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:04.317752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:04.318290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:04.324793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:04.325264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:04.326013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:04.326441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:04.437946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d4f85fa9-ebcb-4cbf-94c7-d2a5a5bbbf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:04.438562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d4f85fa9-ebcb-4cbf-94c7-d2a5a5bbbf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:04.445185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4f85fa9-ebcb-4cbf-94c7-d2a5a5bbbf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:04.445641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4f85fa9-ebcb-4cbf-94c7-d2a5a5bbbf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:04.446409 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4f85fa9-ebcb-4cbf-94c7-d2a5a5bbbf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:04.446847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4f85fa9-ebcb-4cbf-94c7-d2a5a5bbbf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:04.458494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:04.467160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:04.468740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:04.469921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d35c8946-77a4-4786-8d1e-b9fc8a6ccaa6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.156181 Jul 27 20:18:04.470488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 281/564] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:04 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:04.576095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d4f85fa9-ebcb-4cbf-94c7-d2a5a5bbbf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:04.583485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d4f85fa9-ebcb-4cbf-94c7-d2a5a5bbbf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.149452 Jul 27 20:18:04.584062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 284/565] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:05.493897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:05.494501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:05.501172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:05.501620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:05.502372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:05.502809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:05.604706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-335d4388-008c-4828-9626-2a1760cb7bf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:05.605372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-335d4388-008c-4828-9626-2a1760cb7bf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:05.611956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-335d4388-008c-4828-9626-2a1760cb7bf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:05.612433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-335d4388-008c-4828-9626-2a1760cb7bf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:05.613199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-335d4388-008c-4828-9626-2a1760cb7bf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:05.613636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-335d4388-008c-4828-9626-2a1760cb7bf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:05.639994 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:05.648107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:05.650311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:05.651468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-af75e86a-79a3-4008-852c-bae9d514d511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.161766 Jul 27 20:18:05.652050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 282/566] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:05 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:05.741965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-335d4388-008c-4828-9626-2a1760cb7bf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:05.749240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-335d4388-008c-4828-9626-2a1760cb7bf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.148478 Jul 27 20:18:05.749803 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 285/567] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:18:06.673650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:06.674195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:06.681121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:06.681573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:06.682330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:06.682765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:06.770522 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-95dcbb23-1708-4daf-8916-c720c9ecd549 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:06.771132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-95dcbb23-1708-4daf-8916-c720c9ecd549 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:06.777618 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-95dcbb23-1708-4daf-8916-c720c9ecd549 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:06.778063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-95dcbb23-1708-4daf-8916-c720c9ecd549 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:06.778820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-95dcbb23-1708-4daf-8916-c720c9ecd549 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:06.779251 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-95dcbb23-1708-4daf-8916-c720c9ecd549 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:06.822690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:06.831325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:06.832877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:06.834044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ee3df5d9-0e9c-46f1-806d-536ac79b5721 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.164365 Jul 27 20:18:06.844422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 283/568] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:06 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:06.916846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-95dcbb23-1708-4daf-8916-c720c9ecd549 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:06.924193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-95dcbb23-1708-4daf-8916-c720c9ecd549 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.157421 Jul 27 20:18:06.924731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 286/569] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:07.856558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:07.857233 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:07.863677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:07.864127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:07.864899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:07.865581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:07.945186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-21910a0d-968e-407f-ab6a-4f337d809223 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:07.946310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-21910a0d-968e-407f-ab6a-4f337d809223 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:07.952849 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21910a0d-968e-407f-ab6a-4f337d809223 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:07.953300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21910a0d-968e-407f-ab6a-4f337d809223 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:07.954058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21910a0d-968e-407f-ab6a-4f337d809223 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:07.954492 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21910a0d-968e-407f-ab6a-4f337d809223 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:08.003287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:08.011839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:08.013440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:08.014654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-259347f2-542d-41e7-b431-6888a689bc2e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.162055 Jul 27 20:18:08.015290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 284/570] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:07 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:08.090245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-21910a0d-968e-407f-ab6a-4f337d809223 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:08.093653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:08.098004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-21910a0d-968e-407f-ab6a-4f337d809223 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.156698 Jul 27 20:18:08.098571 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 287/571] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:09.036401 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:09.037042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:09.044151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:09.044646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:09.045404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:09.045838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:09.123147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-de9783c3-ad00-4768-8b43-298d367872e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:09.123617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-de9783c3-ad00-4768-8b43-298d367872e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:09.130397 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-de9783c3-ad00-4768-8b43-298d367872e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:09.130848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-de9783c3-ad00-4768-8b43-298d367872e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:09.131604 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-de9783c3-ad00-4768-8b43-298d367872e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:09.132040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-de9783c3-ad00-4768-8b43-298d367872e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:09.183038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:09.191166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:09.192723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:09.193890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-55e74ad2-5bb6-4acd-a4b9-72ca0643c024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.161445 Jul 27 20:18:09.194687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 285/572] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:09.276735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-de9783c3-ad00-4768-8b43-298d367872e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:09.284033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-de9783c3-ad00-4768-8b43-298d367872e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.165416 Jul 27 20:18:09.284629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 288/573] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:09 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:10.217778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:10.218450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:10.224987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:10.225436 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:10.226195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:10.226629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:10.304790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cf473c44-85a1-456c-bb85-1bb56f9cd9e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:10.305682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cf473c44-85a1-456c-bb85-1bb56f9cd9e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:10.311858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf473c44-85a1-456c-bb85-1bb56f9cd9e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:10.312308 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf473c44-85a1-456c-bb85-1bb56f9cd9e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:10.313103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf473c44-85a1-456c-bb85-1bb56f9cd9e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:10.313536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf473c44-85a1-456c-bb85-1bb56f9cd9e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:10.368242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:10.376644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:10.378255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:10.379502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-00b86646-ff73-4fa5-b04f-7e4635ed0979 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.165737 Jul 27 20:18:10.380369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 286/574] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:10.453982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cf473c44-85a1-456c-bb85-1bb56f9cd9e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:10.461637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cf473c44-85a1-456c-bb85-1bb56f9cd9e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.161186 Jul 27 20:18:10.462210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 289/575] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:18:11.403287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:11.403896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:11.410342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:11.410790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:11.411545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:11.411991 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:11.482132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-68fd5688-5405-4db2-9b6e-393a90b5b7f0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:11.482781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-68fd5688-5405-4db2-9b6e-393a90b5b7f0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:11.489292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68fd5688-5405-4db2-9b6e-393a90b5b7f0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:11.489802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68fd5688-5405-4db2-9b6e-393a90b5b7f0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:11.490825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68fd5688-5405-4db2-9b6e-393a90b5b7f0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:11.491296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68fd5688-5405-4db2-9b6e-393a90b5b7f0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:11.565944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:11.574296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:11.575820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:11.577012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-00f1711a-8431-4c66-bdb9-199811b77e81 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.178239 Jul 27 20:18:11.577576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 287/576] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:11 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:11.630801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-68fd5688-5405-4db2-9b6e-393a90b5b7f0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:11.638605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-68fd5688-5405-4db2-9b6e-393a90b5b7f0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.160446 Jul 27 20:18:11.639166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 290/577] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:12.600727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:12.601243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:12.608313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:12.608791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:12.609546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:12.609981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:12.659572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-84c842e3-7377-49de-a4cd-8b26a165e20c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:12.660185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-84c842e3-7377-49de-a4cd-8b26a165e20c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:12.667558 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84c842e3-7377-49de-a4cd-8b26a165e20c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:12.668008 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84c842e3-7377-49de-a4cd-8b26a165e20c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:12.668859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84c842e3-7377-49de-a4cd-8b26a165e20c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:12.669291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84c842e3-7377-49de-a4cd-8b26a165e20c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:12.780844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:12.788878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:12.790978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:12.792132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f67997fd-9fe1-4113-af08-36223525ee6f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.195417 Jul 27 20:18:12.792735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 288/578] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:12 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:12.825295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-84c842e3-7377-49de-a4cd-8b26a165e20c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:12.832750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-84c842e3-7377-49de-a4cd-8b26a165e20c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.176923 Jul 27 20:18:12.833313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 291/579] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:13.814640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:13.815239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:13.822215 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:13.822659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:13.823407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:13.823831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:13.855279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-73ce04e1-6e4f-4486-b138-a9a22f49a1e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:13.856412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-73ce04e1-6e4f-4486-b138-a9a22f49a1e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:13.863601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-73ce04e1-6e4f-4486-b138-a9a22f49a1e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:13.864058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-73ce04e1-6e4f-4486-b138-a9a22f49a1e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:13.864898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-73ce04e1-6e4f-4486-b138-a9a22f49a1e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:13.865589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-73ce04e1-6e4f-4486-b138-a9a22f49a1e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:14.184607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:14.192930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:14.194813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:14.196963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-536611dc-170d-4051-8fa2-3aed9f834370 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.385710 Jul 27 20:18:14.206453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 289/580] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:13 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:14.215331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-73ce04e1-6e4f-4486-b138-a9a22f49a1e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:14.222807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-73ce04e1-6e4f-4486-b138-a9a22f49a1e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.373077 Jul 27 20:18:14.223856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 292/581] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:15.218987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:15.219597 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:15.226137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:15.226580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:15.227331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:15.227761 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:15.243172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9571dec2-9000-4c6d-8e1e-6c77a086c34c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:15.243781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9571dec2-9000-4c6d-8e1e-6c77a086c34c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:15.250198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9571dec2-9000-4c6d-8e1e-6c77a086c34c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:15.250646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9571dec2-9000-4c6d-8e1e-6c77a086c34c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:15.251396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9571dec2-9000-4c6d-8e1e-6c77a086c34c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:15.251824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9571dec2-9000-4c6d-8e1e-6c77a086c34c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:15.421058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:15.429245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:15.431433 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:15.432698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-24ff971a-296a-41ce-aa80-10a1232e7bfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.217567 Jul 27 20:18:15.433363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 290/582] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:15.437234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9571dec2-9000-4c6d-8e1e-6c77a086c34c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:15.444800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9571dec2-9000-4c6d-8e1e-6c77a086c34c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.205698 Jul 27 20:18:15.445401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 293/583] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:15 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:16.454220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:16.454834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:16.461962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:16.462415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:16.463177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:16.463641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:16.465711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b656b383-acb2-4507-9d34-4863a79b5714 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:16.466325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b656b383-acb2-4507-9d34-4863a79b5714 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:16.472704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b656b383-acb2-4507-9d34-4863a79b5714 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:16.473146 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b656b383-acb2-4507-9d34-4863a79b5714 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:16.473895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b656b383-acb2-4507-9d34-4863a79b5714 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:16.474322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b656b383-acb2-4507-9d34-4863a79b5714 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:16.665626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:16.670040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b656b383-acb2-4507-9d34-4863a79b5714 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:16.673594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:16.675105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:16.676265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7d27181b-bd4c-4a6e-9b08-dd4fe5c85c34 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1739 microversion: 2.20 time: 0.225961 Jul 27 20:18:16.676856 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 291/584] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:16 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:16.677693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b656b383-acb2-4507-9d34-4863a79b5714 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.215760 Jul 27 20:18:16.678236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 294/585] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:17.698151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a2712b0e-cfaa-44b0-9e8c-0bea285ee48c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:17.698770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a2712b0e-cfaa-44b0-9e8c-0bea285ee48c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:17.699016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:17.699560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:17.705755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2712b0e-cfaa-44b0-9e8c-0bea285ee48c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:17.706067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:17.706192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2712b0e-cfaa-44b0-9e8c-0bea285ee48c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:17.706519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:17.706948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2712b0e-cfaa-44b0-9e8c-0bea285ee48c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:17.707337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:17.707476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2712b0e-cfaa-44b0-9e8c-0bea285ee48c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:17.708106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:18.006319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:18.013758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a2712b0e-cfaa-44b0-9e8c-0bea285ee48c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:18.014505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:18.016029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:18.017245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e22453d3-0fca-4ae1-a86c-8dcaef18d967 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1721 microversion: 2.20 time: 0.322277 Jul 27 20:18:18.017812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 295/586] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:18.021551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a2712b0e-cfaa-44b0-9e8c-0bea285ee48c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.327202 Jul 27 20:18:18.022113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 292/587] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:19.041055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:19.041663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:19.048843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7bb91d5f-e7cf-44a2-8ab1-72d636c32817 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:19.049445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7bb91d5f-e7cf-44a2-8ab1-72d636c32817 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:19.057378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bb91d5f-e7cf-44a2-8ab1-72d636c32817 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:19.057837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bb91d5f-e7cf-44a2-8ab1-72d636c32817 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:19.058137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:19.058592 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:19.059244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bb91d5f-e7cf-44a2-8ab1-72d636c32817 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:19.059366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:19.059777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:19.059880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bb91d5f-e7cf-44a2-8ab1-72d636c32817 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:19.268727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7bb91d5f-e7cf-44a2-8ab1-72d636c32817 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:19.276834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7bb91d5f-e7cf-44a2-8ab1-72d636c32817 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.231854 Jul 27 20:18:19.277508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 293/588] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:18:19.279660 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:19.287541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:19.289698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:19.290835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9c5a8124-bdca-4d57-a4e9-36527ab33108 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1721 microversion: 2.20 time: 0.254416 Jul 27 20:18:19.291631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 296/589] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:19 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:20.298287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-13ac3b89-e2d0-40c1-ab37-5466b9074e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:20.299665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-13ac3b89-e2d0-40c1-ab37-5466b9074e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:20.306769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13ac3b89-e2d0-40c1-ab37-5466b9074e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:20.308862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13ac3b89-e2d0-40c1-ab37-5466b9074e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:20.308862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13ac3b89-e2d0-40c1-ab37-5466b9074e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:20.308862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13ac3b89-e2d0-40c1-ab37-5466b9074e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:20.314401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:20.315114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:20.321590 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:20.326252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:20.327387 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:20.341047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:20.540167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-13ac3b89-e2d0-40c1-ab37-5466b9074e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:20.547634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:20.549613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-13ac3b89-e2d0-40c1-ab37-5466b9074e44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.255294 Jul 27 20:18:20.554480 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 294/590] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:18:20.555702 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-e7c1387a-1a03-413f-9723-9fc85897985c req-d9ef70d4-3dc7-4d74-b81d-4c58050bac26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31f4cf-e692-45de-8dd8-242a7c0279fa", "name": "network-vif-plugged", "status": "completed", "tag": "94ac9417-69b9-4849-a622-d6629e497fed"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:18:20.556224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:20.557764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:20.558916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d7da86a3-9c93-4939-848a-ad734cced3f2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1721 microversion: 2.20 time: 0.248787 Jul 27 20:18:20.560033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 297/591] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:20 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:20.578838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-e7c1387a-1a03-413f-9723-9fc85897985c req-d9ef70d4-3dc7-4d74-b81d-4c58050bac26 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:20.582950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-e7c1387a-1a03-413f-9723-9fc85897985c req-d9ef70d4-3dc7-4d74-b81d-4c58050bac26 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:20.597638 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-e7c1387a-1a03-413f-9723-9fc85897985c req-d9ef70d4-3dc7-4d74-b81d-4c58050bac26 service nova] Creating event network-vif-plugged:94ac9417-69b9-4849-a622-d6629e497fed for instance af31f4cf-e692-45de-8dd8-242a7c0279fa on hv-cinder-85124 Jul 27 20:18:20.603476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-e7c1387a-1a03-413f-9723-9fc85897985c req-d9ef70d4-3dc7-4d74-b81d-4c58050bac26 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052006 Jul 27 20:18:20.604078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 295/592] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:18:21.569716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3540ba7e-8293-45a6-9081-62f886da70bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:21.570410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3540ba7e-8293-45a6-9081-62f886da70bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:21.576889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3540ba7e-8293-45a6-9081-62f886da70bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:21.577335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3540ba7e-8293-45a6-9081-62f886da70bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:21.578103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3540ba7e-8293-45a6-9081-62f886da70bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:21.578537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3540ba7e-8293-45a6-9081-62f886da70bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:21.582769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:21.583471 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:21.587376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=52 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:21.591034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:21.591481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:21.592246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:21.592713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:21.777995 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3540ba7e-8293-45a6-9081-62f886da70bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:21.785430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3540ba7e-8293-45a6-9081-62f886da70bc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1259 microversion: 2.1 time: 0.219518 Jul 27 20:18:21.785866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:21.786013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 298/593] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:18:21.794962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:21.796651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:21.797902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1d538d11-e84a-4987-9040-92bcfa61662c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1664 microversion: 2.20 time: 0.219286 Jul 27 20:18:21.798566 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 296/594] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1664 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:21.820639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0a1b5c29-03bb-4e93-b653-74adfe1f8edc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4839b5ab-f00f-4f5a-ae86-04e90ed65158"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:18:21.823054 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0a1b5c29-03bb-4e93-b653-74adfe1f8edc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:21.824937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=52 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:21.829626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a1b5c29-03bb-4e93-b653-74adfe1f8edc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:21.831341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a1b5c29-03bb-4e93-b653-74adfe1f8edc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:21.831341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a1b5c29-03bb-4e93-b653-74adfe1f8edc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:21.831341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a1b5c29-03bb-4e93-b653-74adfe1f8edc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:22.624856 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-d4bd362b-fbb2-49f4-b8b8-ec9c8971ae34 req-f5b63743-ded8-4efe-9516-7c82f6189aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0929536d-2d91-4e59-8f36-474025d921ef", "name": "network-vif-unplugged", "status": "completed", "tag": "39cce058-68c6-4a18-8354-201c5dba75c7"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:18:22.635285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-d4bd362b-fbb2-49f4-b8b8-ec9c8971ae34 req-f5b63743-ded8-4efe-9516-7c82f6189aea service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:22.635718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-d4bd362b-fbb2-49f4-b8b8-ec9c8971ae34 req-f5b63743-ded8-4efe-9516-7c82f6189aea service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:22.646395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.compute.server_external_events [req-d4bd362b-fbb2-49f4-b8b8-ec9c8971ae34 req-f5b63743-ded8-4efe-9516-7c82f6189aea service nova] Unable to find a host for instance 0929536d-2d91-4e59-8f36-474025d921ef. Dropping event network-vif-unplugged {{(pid=118274) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 20:18:22.647245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-d4bd362b-fbb2-49f4-b8b8-ec9c8971ae34 req-f5b63743-ded8-4efe-9516-7c82f6189aea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027379 Jul 27 20:18:22.647805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 297/595] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 27 20:18:22.810709 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7b5f2153-43e0-4a03-810a-3d945f24f4b0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:22.811321 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7b5f2153-43e0-4a03-810a-3d945f24f4b0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:22.817390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b5f2153-43e0-4a03-810a-3d945f24f4b0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:22.820704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b5f2153-43e0-4a03-810a-3d945f24f4b0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:22.820704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b5f2153-43e0-4a03-810a-3d945f24f4b0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:22.820704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b5f2153-43e0-4a03-810a-3d945f24f4b0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:22.822986 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:22.841296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0a1b5c29-03bb-4e93-b653-74adfe1f8edc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "POST /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.024486 Jul 27 20:18:22.842920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 299/596] 10.222.0.47 () {62 vars in 1364 bytes} [Wed Jul 27 20:18:21 2022] POST /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 188 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:18:23.023722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5c8c1846-85e0-4828-8c52-2345c06cacbf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:18:23.024318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5c8c1846-85e0-4828-8c52-2345c06cacbf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:23.031523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c8c1846-85e0-4828-8c52-2345c06cacbf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:23.032127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c8c1846-85e0-4828-8c52-2345c06cacbf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:23.033073 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c8c1846-85e0-4828-8c52-2345c06cacbf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:23.033654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c8c1846-85e0-4828-8c52-2345c06cacbf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:23.037096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7b5f2153-43e0-4a03-810a-3d945f24f4b0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:23.044711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7b5f2153-43e0-4a03-810a-3d945f24f4b0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1442 microversion: 2.1 time: 0.237740 Jul 27 20:18:23.045612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 298/597] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1442 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:23.066223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fb5c6f23-f9c9-4f5f-9f8d-b19802787ee7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:23.066836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fb5c6f23-f9c9-4f5f-9f8d-b19802787ee7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:23.073238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb5c6f23-f9c9-4f5f-9f8d-b19802787ee7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:23.073760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb5c6f23-f9c9-4f5f-9f8d-b19802787ee7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:23.074591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb5c6f23-f9c9-4f5f-9f8d-b19802787ee7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:23.075027 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb5c6f23-f9c9-4f5f-9f8d-b19802787ee7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:23.108574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5c8c1846-85e0-4828-8c52-2345c06cacbf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118273) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 20:18:23.260945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fb5c6f23-f9c9-4f5f-9f8d-b19802787ee7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:23.268702 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fb5c6f23-f9c9-4f5f-9f8d-b19802787ee7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1442 microversion: 2.1 time: 0.206935 Jul 27 20:18:23.269273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 299/598] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:18:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1442 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:18:23.355335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:23.420845 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5c8c1846-85e0-4828-8c52-2345c06cacbf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "POST /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/action" status: 202 len: 0 microversion: 2.20 time: 0.401359 Jul 27 20:18:23.421935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 300/599] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Jul 27 20:18:23 2022] POST /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 20:18:23.429916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:23.430525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:23.437259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:23.437259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:23.438023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:23.438456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:23.639271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:23.649958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:23.652059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:23.654740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d0b47a18-a833-4621-ad85-3ad25f85d1b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1750 microversion: 2.20 time: 0.228591 Jul 27 20:18:23.663400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 300/600] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:23 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1750 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:24.682702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:24.683920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:24.691224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:24.691674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:24.692455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:24.692900 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:24.924240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:24.933523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:24.935133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:24.936401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4622f3e6-70b7-48dc-99e9-e59670c55d70 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1750 microversion: 2.20 time: 0.258892 Jul 27 20:18:24.937145 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 301/601] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:24 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1750 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:25.657332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-b1eea652-649b-43f9-90e8-e01c91f8b10d req-be6e2948-7f52-4ab7-b306-a24139a971c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af31f4cf-e692-45de-8dd8-242a7c0279fa", "tag": "94ac9417-69b9-4849-a622-d6629e497fed"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:18:25.668050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-b1eea652-649b-43f9-90e8-e01c91f8b10d req-be6e2948-7f52-4ab7-b306-a24139a971c4 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:25.668509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-b1eea652-649b-43f9-90e8-e01c91f8b10d req-be6e2948-7f52-4ab7-b306-a24139a971c4 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:25.679152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-b1eea652-649b-43f9-90e8-e01c91f8b10d req-be6e2948-7f52-4ab7-b306-a24139a971c4 service nova] Creating event network-changed:94ac9417-69b9-4849-a622-d6629e497fed for instance af31f4cf-e692-45de-8dd8-242a7c0279fa on hv-cinder-85124 Jul 27 20:18:25.684163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-b1eea652-649b-43f9-90e8-e01c91f8b10d req-be6e2948-7f52-4ab7-b306-a24139a971c4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030471 Jul 27 20:18:25.684875 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 301/602] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:18:25.962505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:25.963885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:25.973118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:25.974446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:25.975800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:25.978077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:26.206158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:26.216526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:26.218890 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:26.221231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-71f6e19e-c8e6-4574-8c8b-305148f282f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.264845 Jul 27 20:18:26.222174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 302/603] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:25 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:27.247654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:27.248370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:27.254525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:27.254905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:27.255646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:27.256088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:27.394295 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:27.402628 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:27.404134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:27.405310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-12d52ff0-c701-434d-be44-82e0c8c4e10d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.162308 Jul 27 20:18:27.405861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 302/604] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:27 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:28.427618 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:28.428306 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:28.435347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:28.435800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:28.436597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:28.437038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:28.565360 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:28.573701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:28.575224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:28.576491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3167091e-a011-4a2f-8bfe-64b405c66b72 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152633 Jul 27 20:18:28.576958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 303/605] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:28 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:29.601099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:29.601712 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:29.608520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:29.608966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:29.609724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:29.610154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:29.744033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:29.752514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:29.754030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:29.755181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b0a8a51f-f1d0-4a1e-be58-ce61116ebeac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.159428 Jul 27 20:18:29.755746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 303/606] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:29 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:30.778180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:30.778693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:30.785233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:30.785670 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:30.786415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:30.786838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:30.915469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:30.923639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:30.925165 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:30.926298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e46fbc3c-0058-4dd8-87c7-6545287ddcf9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152052 Jul 27 20:18:30.926849 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 304/607] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:31.950037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:31.950635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:31.957183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:31.957630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:31.958384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:31.958816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:32.084723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:32.093114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:32.094620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:32.095758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b2ddd7ce-8d88-4b41-8f5b-b5df17ba3b1f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149822 Jul 27 20:18:32.096316 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 304/608] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:31 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:33.118465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:33.119079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:33.125579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:33.126018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:33.126766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:33.127196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:33.256282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:33.265156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:33.266658 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:33.267797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c5a17b11-cd8a-4de6-8bbf-ff064ee1a1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153437 Jul 27 20:18:33.268343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 305/609] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:33 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:33.506352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:18:33.506848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:18:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:18:34.291913 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:34.292492 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:34.299021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:34.299470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:34.300228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:34.300689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:34.428113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:34.436419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:34.437939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:34.439092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e1a4f38f-083d-4bd5-8f2b-70736c177dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151784 Jul 27 20:18:34.439642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 305/610] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:35.461941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:35.462547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:35.469038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:35.469489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:35.470242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:35.470674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:35.599961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:35.609306 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:35.610851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:35.611992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-02b76968-fab2-4081-8a1f-f9ed34cc854a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153949 Jul 27 20:18:35.612586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 306/611] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:35 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:36.636074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:36.636699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:36.643183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:36.643654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:36.644443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:36.644898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:36.777103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:36.785547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:36.787184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:36.788335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-928bf551-4aa8-4963-a237-2a3f959fd2f3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156898 Jul 27 20:18:36.788978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 306/612] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:36 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:37.810971 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:37.811575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:37.818008 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:37.818447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:37.819187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:37.820113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:37.946360 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:37.954821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:37.956366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:37.957545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-23361159-c1e1-45c2-af97-ae8f8c999bfb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150454 Jul 27 20:18:37.958154 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 307/613] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:38.985532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:38.986141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:38.992873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:38.993323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:38.994082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:38.994515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:39.122961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:39.131214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:39.133260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:39.134402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-074b3ff0-d736-4dc5-8ab4-a6fd584ef997 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153186 Jul 27 20:18:39.134967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 307/614] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:38 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:40.158333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:40.159019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:40.165913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:40.166353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:40.167093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:40.167519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:40.293374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:40.301599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:40.303106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:40.304318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f2527189-c15b-4235-b745-a8e64eef489b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150017 Jul 27 20:18:40.304907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 308/615] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:41.327256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:41.327919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:41.334386 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:41.334828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:41.335589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:41.336016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:41.470740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:41.479896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:41.488700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:41.488700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a20447b9-e84f-4307-b40a-a8a9e363b502 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.159251 Jul 27 20:18:41.488700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 308/616] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:41 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:18:42.506320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:42.507650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:42.514281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:42.514726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:42.515479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:42.515911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:42.649047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:42.657416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:42.658952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:42.660163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-678cc2a4-4ef8-4e19-909a-986c0db546c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.157804 Jul 27 20:18:42.660774 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 309/617] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:43.686587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:43.687127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:43.696375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:43.696834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:43.697955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:43.698575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:43.833508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:43.843174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:43.844762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:43.845932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-98267ccd-7f49-4560-8e1b-b4bbeeb15b84 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.163923 Jul 27 20:18:43.846492 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 309/618] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:43 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:44.870596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:44.871205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:44.877419 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:44.877863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:44.878613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:44.879043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:45.005495 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:45.015563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:45.017093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:45.018239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-83602e26-1ae2-4415-aff8-a3c74bd9803c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151548 Jul 27 20:18:45.018831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 310/619] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:46.045155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:46.045785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:46.052184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:46.054264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:46.054264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:46.054532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:46.181910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:46.190266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:46.191768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:46.192956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf113cc7-9f55-4209-a026-9a76206c5c30 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151706 Jul 27 20:18:46.197392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 310/620] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:46 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:47.215596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:47.216231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:47.222748 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:47.223193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:47.223945 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:47.224390 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:47.360473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:47.370123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:47.372722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:47.373924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-88221184-f291-444a-af40-0c5884aba47a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.162237 Jul 27 20:18:47.374490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 311/621] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:48.396275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:48.396926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:48.404112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:48.404600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:48.405356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:48.405778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:48.537200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:48.545482 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:48.547047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:48.548198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4cd050b6-b204-45ae-a476-242ab837e1db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155778 Jul 27 20:18:48.548821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 311/622] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:48 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:49.570880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:49.571485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:49.577872 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:49.578311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:49.579060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:49.579486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:49.710151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:49.718334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:49.719829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:49.720991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-22407121-7b45-43ec-aae5-efd732d484a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154029 Jul 27 20:18:49.721547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 312/623] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:50.744524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:50.745059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:50.751406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:50.751849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:50.752614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:50.753042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:50.878592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:50.890522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:50.892022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:50.893195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-31d3c6a0-cd66-4657-a2fb-04da792801eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153106 Jul 27 20:18:50.893755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 312/624] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:50 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:51.915641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:51.916243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:51.918553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:51.923188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:51.923659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:51.924452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:51.924883 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:52.050718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:52.059188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:52.060720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:52.061867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-85e86271-b3d7-47d7-a233-a5c2dfc7f349 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150202 Jul 27 20:18:52.062430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 313/625] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:53.085615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:53.086229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:53.088516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=34 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:53.093238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:53.093688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:53.094447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:53.094924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:53.098765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=85 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:53.227133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:53.235435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:53.236996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:53.238137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f6232e77-a0c7-463d-bf29-4802a235ee1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156947 Jul 27 20:18:53.238699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 313/626] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:53 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:54.261162 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:54.261773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:54.268412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:54.268867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:54.269652 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:54.270088 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:54.395994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:54.404351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:54.405889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:54.407040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1467fac8-03af-4a16-9f33-e63fad0a8511 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149817 Jul 27 20:18:54.407645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 314/627] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:54 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:55.431023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:55.431923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:55.438463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:55.438916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:55.439664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:55.440094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:55.569401 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:55.578263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:55.579778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:55.580951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-23eddd2a-b5b7-4373-bda4-39156c7f9f4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154397 Jul 27 20:18:55.581509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 314/628] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:55 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:56.603452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:56.603981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:56.610496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:56.610948 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:56.611700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:56.612136 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:56.614940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=85 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:56.740334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:56.749317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:56.750850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:56.751994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a45bfe20-80de-4f8a-8748-89d19b0e1a28 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152551 Jul 27 20:18:56.752594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 315/629] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:57.775767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:57.776366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:57.782756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:57.783192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:57.783959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:57.784364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:57.914534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:57.924733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:57.926244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:57.927394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-31e3c9b0-4cc3-4bd8-ba97-a6bbdb708f2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155972 Jul 27 20:18:57.927948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 315/630] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:18:58.953542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:18:58.954160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:18:58.961301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:58.961579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:58.962380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:18:58.962815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:18:59.316869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:59.325880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:59.327466 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:18:59.329721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0c80c6c9-2d44-4112-9d53-6d1edfdb8a3b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.383489 Jul 27 20:18:59.330291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 316/631] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:18:58 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:19:00.353728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:00.354334 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:00.360976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.361418 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:00.362196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.362621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:00.490689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:00.499141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:00.500690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:00.501838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6cb45c29-cdf1-4474-bf80-7321a19da517 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152621 Jul 27 20:19:00.502400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 316/632] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:00 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:01.525177 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:01.525797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:01.532275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:01.532758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:01.533517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:01.533956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:01.662329 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:01.670753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:01.672263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:01.673442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aecff24a-159f-447a-979d-f2073ca2c536 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152758 Jul 27 20:19:01.674019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 317/633] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:02.696165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:02.696793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:02.703164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:02.703604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:02.704345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:02.704796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:02.831043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:02.839816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:02.841360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:02.842531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c0683ada-f75f-4a68-a8fc-8e899bcb8b2b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150336 Jul 27 20:19:02.843090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 317/634] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:02 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:03.865910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:03.867128 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:03.873685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:03.874134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:03.874897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:03.875334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:04.004144 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:04.012782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:04.014267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:04.015409 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c4eb934b-51b5-4af0-a3b6-3efbd0e0ea16 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153664 Jul 27 20:19:04.015963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 318/635] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:05.037426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:05.038012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:05.044461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:05.044905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:05.045648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:05.046073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:05.176020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:05.184977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:05.186998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:05.187684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c6fb05b3-8914-45f7-8d9c-965cf5fd8145 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154155 Jul 27 20:19:05.188259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 318/636] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:05 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:19:06.212167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:06.212738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:06.219315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:06.219759 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:06.220550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:06.220989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:06.351791 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:06.360217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:06.361763 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:06.362914 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0c598407-14ff-4eb0-9970-ea39d2ba1f62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155725 Jul 27 20:19:06.363470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 319/637] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:06 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:07.386524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:07.387137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:07.394109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:07.394559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:07.395319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:07.395778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:07.524537 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:07.532143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:07.533791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:07.534971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-55c56373-766b-42dc-ad3a-2a572b9e431e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152961 Jul 27 20:19:07.535825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 319/638] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:07 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:08.557829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:08.558470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:08.564794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:08.565253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:08.566053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:08.566490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:08.692251 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:08.701178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:08.702664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:08.703802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e7e0a2fb-e62a-47fa-aac0-004248f1e652 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149756 Jul 27 20:19:08.704368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 320/639] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:08 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:09.725370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:09.726641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:09.733087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:09.733539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:09.734297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:09.734739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:09.863256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:09.871867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:09.873393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:09.874551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-de04e46a-badd-488a-a25b-e4a9cbf134c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153052 Jul 27 20:19:09.875110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 320/640] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:10.897932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:10.898477 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:10.904891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:10.905336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:10.906088 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:10.906519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:11.030973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:11.040153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:11.041698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:11.042859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eba6be27-9124-4473-8b42-3c8a785cde40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148866 Jul 27 20:19:11.043506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 321/641] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:12.065466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:12.066079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:12.073226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:12.073678 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:12.074437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:12.074884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:12.203108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:12.211640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:12.213202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:12.214412 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-553a9982-e407-455c-9692-ab7fd1a226c1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152817 Jul 27 20:19:12.215025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 321/642] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:12 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:13.237665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:13.238267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:13.245635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:13.246075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:13.246820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:13.248010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:13.374335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:13.383448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:13.384993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:13.386153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e9992600-f80f-475e-adcb-ca39397aeef5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152547 Jul 27 20:19:13.386720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 322/643] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:13 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:19:14.408776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:14.409390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:14.416469 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:14.417040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:14.417793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:14.418248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:14.542896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:14.551324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:14.552870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:14.554580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-988f99a2-e714-47a1-ae4a-01e50ec843e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149834 Jul 27 20:19:14.555175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 322/644] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:14 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:15.577257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:15.577870 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:15.583877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:15.584328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:15.585957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:15.586391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:15.717747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:15.726627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:15.728136 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:15.729310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-80dcd6d3-0bc4-4b91-abc8-725c377d31fa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156172 Jul 27 20:19:15.729880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 323/645] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:16.752186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:16.752829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:16.759862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:16.760313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:16.761097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:16.761533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:16.886347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:16.894639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:16.896147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:16.897953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a0527f6e-4cb2-453d-9bc4-0bc3a32cf777 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149677 Jul 27 20:19:16.898531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 323/646] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:16 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:17.921763 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:17.922385 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:17.929040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:17.929490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:17.930252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:17.930685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:18.066927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:18.077464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:18.079105 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:18.080407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eb4cf2aa-2eba-40ce-b715-ff0670628082 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.162612 Jul 27 20:19:18.081246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 324/647] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:19.104725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:19.105470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:19.111991 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:19.112374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:19.113170 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:19.113864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:19.243968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:19.252202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:19.253749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:19.254898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8ba22c14-b41f-4445-a341-d2d6bc6e07ba tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155617 Jul 27 20:19:19.255461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 324/648] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:19 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:20.278151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:20.278764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:20.285219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:20.285666 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:20.286419 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:20.286846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:20.417782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:20.426076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:20.427572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:20.428751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-30ca8bf5-6a72-42bd-9dab-8ec3a68a4b32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154465 Jul 27 20:19:20.429307 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 325/649] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:20 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:21.451822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:21.452364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:21.458914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:21.459871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:21.460662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:21.461096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:21.586366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:21.594641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:21.596144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:21.597315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-65b7fd2f-c4f0-4e47-890a-c5f2e5ea54f1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149535 Jul 27 20:19:21.597884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 325/650] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:22.620892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:22.621508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:22.623920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=26 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:22.628940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:22.629411 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:22.630223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:22.630627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:22.757458 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:22.767148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:22.768668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:22.769829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-91658e87-5cfc-4b7e-8cc3-194c0b6a7d0f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152903 Jul 27 20:19:22.770591 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 326/651] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:23.793459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:23.794069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:23.796509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=26 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:23.801283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:23.801735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:23.807917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:23.807917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:23.807917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=78 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:23.935407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:23.944317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:23.945865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:23.947019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-728e0504-6c0c-498f-bbdc-1e1c7daa4a2d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.157465 Jul 27 20:19:23.947591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 326/652] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:23 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:24.969878 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:24.970519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:24.977357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:24.977801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:24.978544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:24.978974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:25.104180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:25.112507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:25.114261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:25.116002 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-420e0b3e-71a9-46e9-9880-c803e79c2884 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149420 Jul 27 20:19:25.116618 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 327/653] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:24 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:26.138504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:26.139105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:26.145268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:26.145773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:26.147060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:26.147484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:26.278122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:26.286541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:26.288793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:26.289956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2e53e8a8-1286-4a3c-ba42-9aeb451d7c13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155668 Jul 27 20:19:26.290521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 327/654] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:26 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:27.313596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:27.314212 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:27.321347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:27.321798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:27.322558 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:27.322993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:27.325547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=78 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:27.449779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:27.458500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:27.460023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:27.461203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-47b352b4-55ba-4398-af7c-8c5ea06c11e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151605 Jul 27 20:19:27.461768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 328/655] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:27 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:28.483832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:28.484462 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:28.491244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:28.491695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:28.492479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:28.492914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:28.619698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:28.628466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:28.630167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:28.631616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-04a993e4-168d-4d95-91c4-1eaf86d4227d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151723 Jul 27 20:19:28.632175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 328/656] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:28 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:29.654800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:29.655423 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:29.662561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:29.663017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:29.663776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:29.664213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:29.798115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:29.806524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:29.808024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:29.809200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a190910f-13c6-4cf8-b823-ce515f52edc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.158218 Jul 27 20:19:29.809758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 329/657] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:29 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:30.830962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:30.831652 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:30.838373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:30.838829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:30.839591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:30.840027 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:30.971232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:30.979034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:30.980580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:30.981736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c01a25ed-d764-4a74-a8ad-36cb4526079f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154618 Jul 27 20:19:30.982302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 329/658] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:32.006012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:32.006656 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:32.013094 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:32.013548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:32.014311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:32.014749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:32.143351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:32.151636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:32.153187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:32.154343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1a608db6-9e78-4563-942e-871ce352e5b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152935 Jul 27 20:19:32.154910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 330/659] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:32 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:33.177407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:33.177942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:33.184368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:33.184902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:33.185656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:33.186080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:33.319145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:33.327528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:33.329056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:33.330211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-36716d57-0c07-415a-9671-35a1b8c472b8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156744 Jul 27 20:19:33.330757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 330/660] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:33 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:34.358317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:34.358930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:34.366417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:34.366866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:34.367622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:34.368060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:34.497889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:34.507034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:34.508582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:34.509738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-87265d8e-b1f1-43f4-a2c1-bff6cf1acff6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155378 Jul 27 20:19:34.510334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 331/661] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:35.532579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:35.533184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:35.539643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:35.540094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:35.540872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:35.541301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:35.670066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:35.678847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:35.680352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:35.681613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-74fd1678-191c-4636-9314-3a5a3b75f181 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153006 Jul 27 20:19:35.682181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 331/662] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:35 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:36.705338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:36.705905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:36.713429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:36.713871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:36.714621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:36.715046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:36.840804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:36.849455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:36.850974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:36.852122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-906fbc12-ff45-4660-93aa-64077417b5b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150849 Jul 27 20:19:36.852970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 332/663] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:36 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:37.875033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:37.875638 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:37.882092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:37.882539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:37.883291 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:37.883724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:38.010679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:38.018862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:38.020359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:38.021517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4bce7533-3110-4e0a-b2cb-22f5246ad717 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150382 Jul 27 20:19:38.022572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 332/664] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:39.044318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:39.044965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:39.051427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:39.051881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:39.052674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:39.053160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:39.182496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:39.190774 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:39.192310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:39.193997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c96dc371-baaa-4ba5-804f-9a406188b0eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153072 Jul 27 20:19:39.194547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 333/665] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:39 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:40.215568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:40.216174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:40.222322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:40.222769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:40.223520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:40.223950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:40.354867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:40.363339 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:40.364883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:40.366527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6c53aa70-d242-4740-82af-30711f369b62 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154768 Jul 27 20:19:40.367086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 333/666] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:41.389909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:41.390526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:41.398075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:41.398529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:41.399300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:41.399737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:41.525503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:41.533822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:41.535381 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:41.536562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ae0ea67c-b7b4-4979-843b-440a60cb5683 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150544 Jul 27 20:19:41.537129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 334/667] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:41 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:42.559682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:42.560208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:42.566715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:42.567156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:42.567892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:42.568916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:42.695917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:42.704195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:42.705728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:42.706864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2055330d-364c-4d25-b8fb-4b143d7316e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151145 Jul 27 20:19:42.707417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 334/668] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:43.729137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:43.729865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:43.736288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:43.736831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:43.737581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:43.738269 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:43.870190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:43.878640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:43.880133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:43.882042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-53316449-12b1-4165-ad90-19c19872e04f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156781 Jul 27 20:19:43.882600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 335/669] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:43 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:44.905446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:44.906044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:44.913067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:44.913506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:44.914246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:44.914667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:45.040101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:45.048574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:45.050109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:45.051280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c5187fc7-f754-4d1e-9c11-7be0824ca564 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149667 Jul 27 20:19:45.051837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 335/670] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:46.074280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:46.074920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:46.081352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:46.081823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:46.082571 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:46.083003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:46.215812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:46.224300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:46.226017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:46.227159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-31c4e77b-6af1-4ff2-a0af-142b6167e97f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156738 Jul 27 20:19:46.227798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 336/671] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:46 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:47.250865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:47.251507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:47.258640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:47.259093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:47.259855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:47.260290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:47.389811 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:47.398114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:47.399599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:47.400757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0d4efa71-60d3-4e35-9de4-2deab6f8bb4d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153876 Jul 27 20:19:47.401326 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 336/672] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:48.432864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:48.433474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:48.439919 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:48.440369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:48.441147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:48.441584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:48.570481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:48.578701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:48.580204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:48.581384 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-244fab61-b102-42bb-8b53-e840fdfb8711 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152425 Jul 27 20:19:48.581944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 337/673] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:48 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:49.603896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:49.604424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:49.610820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:49.611261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:49.612001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:49.612451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:49.741492 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:49.750348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:49.751863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:49.753049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3f368254-3d5e-41e2-a64e-2cf904f47e3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153140 Jul 27 20:19:49.753644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 337/674] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:50.775862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:50.776602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:50.782826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:50.783273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:50.784025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:50.784489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:50.909670 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:50.917936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:50.919444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:50.920624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e993c0bb-aa85-4d65-8e35-d2cdb8f4d4e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148551 Jul 27 20:19:50.921189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 338/675] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:50 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:51.943690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:51.944299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:51.950746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:51.951183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:51.951939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:51.952400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:52.084014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:52.092303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:52.093842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:52.094993 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-57953248-67bb-463a-9086-e04feea425a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155847 Jul 27 20:19:52.095553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 338/676] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:53.117796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:53.118332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:53.120749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=26 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:53.125467 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:53.125902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:53.126656 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:53.127086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:53.254182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:53.263104 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:53.264642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:53.265793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f5715b18-fe95-4fb1-8d90-abf687aeb185 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152513 Jul 27 20:19:53.266353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 339/677] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:53 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:54.288529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:54.289132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:54.291431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=26 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:54.296127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:54.296613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:54.297358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:54.297812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:54.300299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=78 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:54.427653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:54.435869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:54.437474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:54.438598 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-458cb737-1261-41d5-ad1a-7ee1ec7515a1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154012 Jul 27 20:19:54.439152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 339/678] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:54 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:55.462700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:55.463312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:55.469972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:55.470634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:55.471253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:55.471694 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:55.597266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:55.605455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:55.606951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:55.608078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0b201aa2-c75e-43b4-a186-ccf467785657 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149824 Jul 27 20:19:55.608677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 340/679] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:55 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:56.631808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:56.632398 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:56.638543 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:56.638999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:56.639759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:56.640190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:56.767324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:56.778333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:56.779864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:56.781047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-27d94f9a-f92c-4334-aeb7-2bb3e17afaea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153781 Jul 27 20:19:56.781612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 340/680] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:57.804517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:57.805135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:57.811576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:57.812029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:57.812817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:57.813254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:57.815772 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=78 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:57.943846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:57.952215 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:57.953757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:57.954922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5b14e8a0-1c6b-4141-acac-b4260a05cbf3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154974 Jul 27 20:19:57.955481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 341/681] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:19:58.977512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:58.978121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:58.984807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:58.985254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:58.986012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:58.986438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:59.110764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:59.119769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:59.121324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:59.122472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-88e3c96e-1f37-4d24-8a18-06ae7abdfbef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148894 Jul 27 20:19:59.123039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 341/682] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:19:58 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:00.145066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:00.146350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:00.152856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:00.153304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:00.154062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:00.154498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:00.285337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:00.293624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:00.295129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:00.296273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-47efc72d-39a7-4cd2-877b-99d2c5ef87ad tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155140 Jul 27 20:20:00.296868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 342/683] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:00 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:01.320121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:01.320829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:01.327526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:01.327977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:01.328832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:01.329260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:01.463459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:01.471651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:01.473199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:01.475869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-57976d97-c62a-420d-81ca-5357482a89c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.160708 Jul 27 20:20:01.476830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 342/684] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:02.499050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:02.499659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:02.506137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:02.506590 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:02.507345 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:02.507781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:02.636859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:02.645583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:02.647079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:02.648221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0cbeac8a-d87b-4574-84aa-c6e9cb894c00 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153043 Jul 27 20:20:02.648817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 343/685] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:02 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:03.671427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:03.671968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:03.678495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:03.678938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:03.679692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:03.680121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:03.806556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:03.814831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:03.816653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:03.818330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-328085f5-525b-4c19-85ae-7bfb75e52008 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150867 Jul 27 20:20:03.818898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 343/686] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:04.841502 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:04.842136 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:04.849265 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:04.849712 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:04.850463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:04.850893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:04.976222 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:04.984648 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:04.986152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:04.987545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ce127544-5c8a-42e2-b4d6-f3df22e5d34b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149704 Jul 27 20:20:04.988129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 344/687] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:04 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:06.010793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:06.011401 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:06.018337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:06.018787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:06.019838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:06.020276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:06.149865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:06.158341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:06.159852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:06.161532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0c001e27-ec02-4dc7-933f-6389ceb201e8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154888 Jul 27 20:20:06.162102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 344/688] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:06 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:07.184730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:07.185379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:07.191806 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:07.192255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:07.193049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:07.193490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:07.318256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:07.326567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:07.328076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:07.329348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-39ae446b-e32f-4991-8fd8-259b217607f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148559 Jul 27 20:20:07.329922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 345/689] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:07 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:08.353276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:08.353923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:08.360407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:08.360865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:08.361627 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:08.362061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:08.492318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:08.500640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:08.502171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:08.503309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6671b89b-3a05-46a2-957c-909ef24c5513 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153943 Jul 27 20:20:08.503872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 345/690] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:08 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:09.209845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:20:09.210087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:20:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:20:09.526785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:09.527387 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:09.533813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:09.534262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:09.535001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:09.536067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:09.664874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:09.673167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:09.674682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:09.675836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-de6a534e-8f7d-4fe8-977c-b9e062584d89 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152994 Jul 27 20:20:09.676417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 346/691] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:10.698640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:10.699156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:10.705914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:10.706357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:10.707102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:10.707523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:10.834379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:10.842595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:10.844100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:10.845344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-905c1c10-ad40-477d-9aa8-6b4b1030c8b5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150716 Jul 27 20:20:10.845900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 346/692] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:11.870914 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:11.872068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:11.879513 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:11.880167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:11.881254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:11.881586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:12.027404 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:12.036343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:12.037877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:12.039024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2bbfc3fb-e391-4ed9-89e9-648bcf515192 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.173504 Jul 27 20:20:12.039581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 347/693] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:11 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:13.062118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:13.062730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:13.069337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:13.069781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:13.070561 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:13.071021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:13.197694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:13.207575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:13.209406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:13.210563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0e9a98be-adaa-4daa-bf88-2cfabd4d8caf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152407 Jul 27 20:20:13.211124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 347/694] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:13 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:14.234416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:14.235043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:14.241819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:14.242259 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:14.243022 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:14.243434 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:14.372704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:14.380977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:14.382462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:14.383636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6c7d2f75-7df4-4f9f-9070-9ea00842d4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153295 Jul 27 20:20:14.384195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 348/695] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:14 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:15.406355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:15.406967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:15.413787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:15.414364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:15.415132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:15.415566 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:15.543909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:15.552850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:15.554356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:15.555505 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ed94ea83-834a-45ae-ab05-f96855a6c578 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153157 Jul 27 20:20:15.556064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 348/696] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:16.578696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:16.579301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:16.586500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:16.586947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:16.587700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:16.588131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:16.715409 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:16.723851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:16.725369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:16.726515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8e32f964-866f-4e8b-9427-5046f7e93077 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151709 Jul 27 20:20:16.727077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 349/697] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:16 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:17.752396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:17.753007 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:17.759924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:17.760395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:17.761164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:17.761597 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:17.885870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:17.894648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:17.896173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:17.897352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8388d717-60ed-46e8-b03a-dca6a3bc1745 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149775 Jul 27 20:20:17.897914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 349/698] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:18.920557 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:18.921167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:18.928267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:18.928741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:18.929493 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:18.929927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:19.056836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:19.066053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:19.067542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:19.068747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b0f2f2e3-443c-4cb9-b566-a4ac826d53df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152081 Jul 27 20:20:19.069295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 350/699] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:18 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:20.091038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:20.091726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:20.098411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:20.098866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:20.099621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:20.100056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:20.230923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:20.240055 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:20.241615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:20.242770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-84ef31ea-09ad-439c-8b2a-8c482dc7a655 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155639 Jul 27 20:20:20.243333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 350/700] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:20 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:21.265773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:21.266373 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:21.273391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:21.273830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:21.274602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:21.275032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:21.402693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:21.411450 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:21.413084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:21.414237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-af793b5a-1048-4514-8d4d-86ff42bfff5e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152378 Jul 27 20:20:21.414787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 351/701] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:22.437222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:22.437828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:22.444304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:22.444799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:22.445557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:22.445986 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:22.580364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:22.589274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:22.590788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:22.591928 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9cbf2478-bb92-467a-8d39-38a6b7045419 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.158552 Jul 27 20:20:22.592705 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 351/702] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:23.615818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:23.616373 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:23.618677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=26 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:23.623547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:23.624000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:23.624786 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:23.625220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:23.751218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:23.759487 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:23.761032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:23.762186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f5cee036-4948-4431-b753-ba232e42ee38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151165 Jul 27 20:20:23.762749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 352/703] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:23 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:24.087629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-565ddcef-4aaf-43ee-a39d-2491dd0d1e0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:20:24.088160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-565ddcef-4aaf-43ee-a39d-2491dd0d1e0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:24.094591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-565ddcef-4aaf-43ee-a39d-2491dd0d1e0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:24.095032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-565ddcef-4aaf-43ee-a39d-2491dd0d1e0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:24.095783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-565ddcef-4aaf-43ee-a39d-2491dd0d1e0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:24.096213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-565ddcef-4aaf-43ee-a39d-2491dd0d1e0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:24.118004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-565ddcef-4aaf-43ee-a39d-2491dd0d1e0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lazy-loading 'flavor' on Instance uuid af31f4cf-e692-45de-8dd8-242a7c0279fa {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:20:24.340922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:24.348115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-565ddcef-4aaf-43ee-a39d-2491dd0d1e0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "POST /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa/action" status: 202 len: 0 microversion: 2.1 time: 0.264281 Jul 27 20:20:24.348775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 352/704] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:20:24 2022] POST /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:20:24.356824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4251a3f4-4729-4bfb-bd71-38c80049c435 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:24.357508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4251a3f4-4729-4bfb-bd71-38c80049c435 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:24.364465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4251a3f4-4729-4bfb-bd71-38c80049c435 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:24.364917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4251a3f4-4729-4bfb-bd71-38c80049c435 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:24.365681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4251a3f4-4729-4bfb-bd71-38c80049c435 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:24.366118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4251a3f4-4729-4bfb-bd71-38c80049c435 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:24.526453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4251a3f4-4729-4bfb-bd71-38c80049c435 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:24.534067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4251a3f4-4729-4bfb-bd71-38c80049c435 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.181035 Jul 27 20:20:24.534691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 353/705] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:24.891145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:24.891853 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:24.894164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:24.899254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:24.899707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:24.900499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:24.900937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:25.095864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:25.105112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:25.106636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:25.107842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3dd33094-5727-4c4e-a4b6-5c5ab0a64164 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.326311 Jul 27 20:20:25.108464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 353/706] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:24 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:25.555822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ed770179-8d3e-455e-b5cc-ca20cdba8170 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:25.556459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ed770179-8d3e-455e-b5cc-ca20cdba8170 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:25.563159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed770179-8d3e-455e-b5cc-ca20cdba8170 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:25.563607 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed770179-8d3e-455e-b5cc-ca20cdba8170 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:25.564464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed770179-8d3e-455e-b5cc-ca20cdba8170 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:25.565004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed770179-8d3e-455e-b5cc-ca20cdba8170 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:25.719015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ed770179-8d3e-455e-b5cc-ca20cdba8170 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:25.726542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ed770179-8d3e-455e-b5cc-ca20cdba8170 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.174574 Jul 27 20:20:25.727113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 354/707] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:26.132114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:26.132762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:26.139306 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:26.139763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:26.140558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:26.140993 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:26.271933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:26.280219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:26.281749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:26.282895 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a7e67f23-01ac-4703-8f80-d85a7a50ff94 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155543 Jul 27 20:20:26.283458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 354/708] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:26 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:26.747097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f52a8462-9c2b-41fd-a311-fe252e3524b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:26.747697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f52a8462-9c2b-41fd-a311-fe252e3524b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:26.754347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f52a8462-9c2b-41fd-a311-fe252e3524b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:26.754789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f52a8462-9c2b-41fd-a311-fe252e3524b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:26.755542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f52a8462-9c2b-41fd-a311-fe252e3524b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:26.755968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f52a8462-9c2b-41fd-a311-fe252e3524b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:26.881816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f52a8462-9c2b-41fd-a311-fe252e3524b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:26.889101 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f52a8462-9c2b-41fd-a311-fe252e3524b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.145751 Jul 27 20:20:26.889694 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 355/709] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:27.305925 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:27.306539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:27.313012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:27.313462 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:27.314222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:27.314660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:27.444305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:27.454174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:27.455706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:27.457417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-338e246c-a68c-4744-9aab-3440fcdd154f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154993 Jul 27 20:20:27.457985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 355/710] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:27 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:27.544689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:20:27.544848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:20:27.910441 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aa2b5be5-cfc9-4811-84ca-45bc32c10bc8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:27.911052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aa2b5be5-cfc9-4811-84ca-45bc32c10bc8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:27.919199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa2b5be5-cfc9-4811-84ca-45bc32c10bc8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:27.919698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa2b5be5-cfc9-4811-84ca-45bc32c10bc8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:27.921894 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa2b5be5-cfc9-4811-84ca-45bc32c10bc8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:27.922370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa2b5be5-cfc9-4811-84ca-45bc32c10bc8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:27.927778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=90 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:28.052864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aa2b5be5-cfc9-4811-84ca-45bc32c10bc8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:28.060374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aa2b5be5-cfc9-4811-84ca-45bc32c10bc8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153794 Jul 27 20:20:28.060958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 356/711] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:27 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:28.479884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:28.480511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:28.487211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:28.487656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:28.488926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:28.489354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:28.617574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:28.625835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:28.627329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:28.628516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7aa83b94-2b4a-4861-821f-2a9ec793f55f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152473 Jul 27 20:20:28.629086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 356/712] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:28 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:29.082048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-04d46b8a-de7e-4074-89da-d19a7305b78f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:29.082661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-04d46b8a-de7e-4074-89da-d19a7305b78f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:29.089181 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04d46b8a-de7e-4074-89da-d19a7305b78f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:29.089626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04d46b8a-de7e-4074-89da-d19a7305b78f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:29.090382 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04d46b8a-de7e-4074-89da-d19a7305b78f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:29.090814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04d46b8a-de7e-4074-89da-d19a7305b78f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:29.217988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-04d46b8a-de7e-4074-89da-d19a7305b78f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:29.226398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-04d46b8a-de7e-4074-89da-d19a7305b78f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148286 Jul 27 20:20:29.226968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 357/713] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:29.651349 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:29.651952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:29.658327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:29.658767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:29.659509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:29.660001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:29.792501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:29.801427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:29.802942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:29.804092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-71be3178-8129-422b-92ff-523a415a37fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156632 Jul 27 20:20:29.804681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 357/714] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:29 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:30.246785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e874b65c-4b29-4c3e-9e32-a2d9797e7cb5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:30.247398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e874b65c-4b29-4c3e-9e32-a2d9797e7cb5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:30.253921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e874b65c-4b29-4c3e-9e32-a2d9797e7cb5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:30.254370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e874b65c-4b29-4c3e-9e32-a2d9797e7cb5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:30.255120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e874b65c-4b29-4c3e-9e32-a2d9797e7cb5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:30.255548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e874b65c-4b29-4c3e-9e32-a2d9797e7cb5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:30.382543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e874b65c-4b29-4c3e-9e32-a2d9797e7cb5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:30.389886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e874b65c-4b29-4c3e-9e32-a2d9797e7cb5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.146930 Jul 27 20:20:30.390454 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 358/715] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:30.828584 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:30.829191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:30.835628 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:30.836070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:30.836854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:30.837283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:30.980829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:30.991675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:30.993210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:30.994356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4af28af3-9991-4f1b-ac4a-cf1272954cef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.169715 Jul 27 20:20:30.994904 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 358/716] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:31.411696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-65d33de0-152f-40c3-9b1a-6dda68d3c747 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:31.412309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-65d33de0-152f-40c3-9b1a-6dda68d3c747 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:31.418817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-65d33de0-152f-40c3-9b1a-6dda68d3c747 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:31.419262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-65d33de0-152f-40c3-9b1a-6dda68d3c747 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:31.420012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-65d33de0-152f-40c3-9b1a-6dda68d3c747 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:31.420490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-65d33de0-152f-40c3-9b1a-6dda68d3c747 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:31.550235 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-65d33de0-152f-40c3-9b1a-6dda68d3c747 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:31.557869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-65d33de0-152f-40c3-9b1a-6dda68d3c747 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150716 Jul 27 20:20:31.558445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 359/717] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:32.018807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:32.019426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:32.025938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:32.026393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:32.027315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:32.027692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:32.154835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:32.163256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:32.164794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:32.165944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cdc6c5e0-c4f0-4411-9560-bc2654981aaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150976 Jul 27 20:20:32.166506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 359/718] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:32 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:32.579750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e1742c6a-73b8-4ee9-bfca-f27ac7d3ead2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:32.580408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e1742c6a-73b8-4ee9-bfca-f27ac7d3ead2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:32.586873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1742c6a-73b8-4ee9-bfca-f27ac7d3ead2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:32.587322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1742c6a-73b8-4ee9-bfca-f27ac7d3ead2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:32.588079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1742c6a-73b8-4ee9-bfca-f27ac7d3ead2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:32.588553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1742c6a-73b8-4ee9-bfca-f27ac7d3ead2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:32.718713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e1742c6a-73b8-4ee9-bfca-f27ac7d3ead2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:32.726682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e1742c6a-73b8-4ee9-bfca-f27ac7d3ead2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150846 Jul 27 20:20:32.727246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 360/719] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:33.189600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:33.190196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:33.198341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:33.198783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:33.199533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:33.199956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:33.328515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:33.337530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:33.339038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:33.340192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-84e29e3a-f49e-4102-a907-d33031551a8a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154489 Jul 27 20:20:33.340781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 360/720] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:33 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:33.747888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f936db5b-a180-4138-9a97-70959a7f490a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:33.748560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f936db5b-a180-4138-9a97-70959a7f490a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:33.755595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f936db5b-a180-4138-9a97-70959a7f490a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:33.756040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f936db5b-a180-4138-9a97-70959a7f490a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:33.756822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f936db5b-a180-4138-9a97-70959a7f490a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:33.757256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f936db5b-a180-4138-9a97-70959a7f490a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:33.886779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f936db5b-a180-4138-9a97-70959a7f490a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:33.895398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f936db5b-a180-4138-9a97-70959a7f490a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151205 Jul 27 20:20:33.895964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 361/721] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:33 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:34.363616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:34.364219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:34.370640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:34.371110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:34.371851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:34.372299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:34.500628 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:34.509645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:34.511202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:34.512342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aaa7b0ad-d5d6-489e-929d-08f1e80ad8d1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153479 Jul 27 20:20:34.512922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 361/722] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:34.916709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a07452bf-b97d-41bb-98c0-9a861baff780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:34.917333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a07452bf-b97d-41bb-98c0-9a861baff780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:34.924205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a07452bf-b97d-41bb-98c0-9a861baff780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:34.924671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a07452bf-b97d-41bb-98c0-9a861baff780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:34.925997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a07452bf-b97d-41bb-98c0-9a861baff780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:34.926430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a07452bf-b97d-41bb-98c0-9a861baff780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:35.172538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a07452bf-b97d-41bb-98c0-9a861baff780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:35.182132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a07452bf-b97d-41bb-98c0-9a861baff780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.268801 Jul 27 20:20:35.184727 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 362/723] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:35.535553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:35.536163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:35.542562 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:35.543011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:35.543771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:35.544203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:35.671497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:35.679860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:35.690806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:35.690806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2406fbe3-91f0-4836-8b13-0370b022d6a2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151453 Jul 27 20:20:35.690806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 362/724] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:35 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:36.207006 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fe26fd01-df98-4885-9087-49b82f103af5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:36.207719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fe26fd01-df98-4885-9087-49b82f103af5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:36.214304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fe26fd01-df98-4885-9087-49b82f103af5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:36.214749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fe26fd01-df98-4885-9087-49b82f103af5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:36.215506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fe26fd01-df98-4885-9087-49b82f103af5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:36.215962 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fe26fd01-df98-4885-9087-49b82f103af5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:36.346045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fe26fd01-df98-4885-9087-49b82f103af5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:36.353549 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fe26fd01-df98-4885-9087-49b82f103af5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151822 Jul 27 20:20:36.354123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 363/725] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:36.711634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:36.712243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:36.718638 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:36.719078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:36.719828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:36.720254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:36.849237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:36.857494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:36.859008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:36.860166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8b59782b-1579-4efd-9707-b179302872b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152424 Jul 27 20:20:36.860764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 363/726] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:36 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:20:37.374999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-318c0bc6-48e0-4b66-aeb9-48e767e64317 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:37.375625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-318c0bc6-48e0-4b66-aeb9-48e767e64317 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:37.382455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-318c0bc6-48e0-4b66-aeb9-48e767e64317 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:37.382906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-318c0bc6-48e0-4b66-aeb9-48e767e64317 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:37.383663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-318c0bc6-48e0-4b66-aeb9-48e767e64317 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:37.384099 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-318c0bc6-48e0-4b66-aeb9-48e767e64317 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:37.513064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-318c0bc6-48e0-4b66-aeb9-48e767e64317 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:37.521275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-318c0bc6-48e0-4b66-aeb9-48e767e64317 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150158 Jul 27 20:20:37.521845 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 364/727] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:37.883988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:37.884636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:37.891048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:37.891502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:37.892284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:37.892750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:38.022896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:38.031206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:38.032762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:38.033912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-205998c4-2b09-4884-9100-aa16d0ea066d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153842 Jul 27 20:20:38.034481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 364/728] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:38.542509 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4463ca73-0e78-48ce-a636-29a42f5c282f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:38.543111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4463ca73-0e78-48ce-a636-29a42f5c282f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:38.549557 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4463ca73-0e78-48ce-a636-29a42f5c282f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:38.550695 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4463ca73-0e78-48ce-a636-29a42f5c282f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:38.551472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4463ca73-0e78-48ce-a636-29a42f5c282f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:38.551901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4463ca73-0e78-48ce-a636-29a42f5c282f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:38.682641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4463ca73-0e78-48ce-a636-29a42f5c282f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:38.690010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4463ca73-0e78-48ce-a636-29a42f5c282f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151374 Jul 27 20:20:38.690581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 365/729] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:39.057053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:39.057667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:39.064098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:39.064589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:39.065328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:39.065758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:39.190216 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:39.198442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:39.199945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:39.201124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-676813b1-b32c-47bf-9d10-e1672f002e40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.147956 Jul 27 20:20:39.201680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 365/730] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:39 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:39.711361 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-79d93a9c-dec4-4dd5-a7d9-75109c69e4d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:39.711924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-79d93a9c-dec4-4dd5-a7d9-75109c69e4d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:39.718380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79d93a9c-dec4-4dd5-a7d9-75109c69e4d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:39.718830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79d93a9c-dec4-4dd5-a7d9-75109c69e4d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:39.719577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79d93a9c-dec4-4dd5-a7d9-75109c69e4d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:39.720012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79d93a9c-dec4-4dd5-a7d9-75109c69e4d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:39.851587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-79d93a9c-dec4-4dd5-a7d9-75109c69e4d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:39.859023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-79d93a9c-dec4-4dd5-a7d9-75109c69e4d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152210 Jul 27 20:20:39.859594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 366/731] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:40.224187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:40.224901 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:40.231360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:40.231809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:40.232605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:40.233042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:40.359316 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:40.368064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:40.369601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:40.370732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7ccc5af2-e23e-43a8-8140-ce25f9e92863 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151062 Jul 27 20:20:40.371279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 366/732] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:40.880904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4901e1d6-c5f4-4954-8c74-ac92fe2ccf77 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:40.881519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4901e1d6-c5f4-4954-8c74-ac92fe2ccf77 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:40.888010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4901e1d6-c5f4-4954-8c74-ac92fe2ccf77 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:40.888496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4901e1d6-c5f4-4954-8c74-ac92fe2ccf77 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:40.889264 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4901e1d6-c5f4-4954-8c74-ac92fe2ccf77 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:40.889696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4901e1d6-c5f4-4954-8c74-ac92fe2ccf77 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:40.956997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-7b9974fb-67ee-4408-9620-2808556573b7 req-b236d63d-4649-4142-9fbb-5b8e450a2b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31f4cf-e692-45de-8dd8-242a7c0279fa", "name": "network-vif-unplugged", "status": "completed", "tag": "94ac9417-69b9-4849-a622-d6629e497fed"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:20:40.966812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-7b9974fb-67ee-4408-9620-2808556573b7 req-b236d63d-4649-4142-9fbb-5b8e450a2b5a service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:40.967257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-7b9974fb-67ee-4408-9620-2808556573b7 req-b236d63d-4649-4142-9fbb-5b8e450a2b5a service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:40.982807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-7b9974fb-67ee-4408-9620-2808556573b7 req-b236d63d-4649-4142-9fbb-5b8e450a2b5a service nova] Creating event network-vif-unplugged:94ac9417-69b9-4849-a622-d6629e497fed for instance af31f4cf-e692-45de-8dd8-242a7c0279fa on hv-cinder-85124 Jul 27 20:20:40.989344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-7b9974fb-67ee-4408-9620-2808556573b7 req-b236d63d-4649-4142-9fbb-5b8e450a2b5a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092717 Jul 27 20:20:40.990275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 367/733] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:20:41.028011 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4901e1d6-c5f4-4954-8c74-ac92fe2ccf77 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:41.036771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4901e1d6-c5f4-4954-8c74-ac92fe2ccf77 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.160315 Jul 27 20:20:41.037365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 367/734] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:40 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:41.394311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:41.394997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:41.401192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:41.401649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:41.402394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:41.402826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:41.529240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:41.538012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:41.539512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:41.540679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bd6de72a-ddfc-494a-b39d-a5698582f28e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151057 Jul 27 20:20:41.541257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 368/735] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:41 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:42.058043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-265373b1-84e9-495b-9996-0dba6c36aa41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:42.058707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-265373b1-84e9-495b-9996-0dba6c36aa41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:42.065229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-265373b1-84e9-495b-9996-0dba6c36aa41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:42.065689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-265373b1-84e9-495b-9996-0dba6c36aa41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:42.066455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-265373b1-84e9-495b-9996-0dba6c36aa41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:42.066914 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-265373b1-84e9-495b-9996-0dba6c36aa41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:42.192464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-265373b1-84e9-495b-9996-0dba6c36aa41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:42.199886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-265373b1-84e9-495b-9996-0dba6c36aa41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.145814 Jul 27 20:20:42.200576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 368/736] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:42.564549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:42.565185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:42.571738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:42.572176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:42.572955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:42.573383 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:42.701684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:42.710337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:42.711824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:42.712989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0b9c5e2e-31de-4711-aa5f-8bf31e37de0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152419 Jul 27 20:20:42.713545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 369/737] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:43.221057 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bafde49f-afe2-4fab-bf43-3380fa33bcf6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:43.222254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bafde49f-afe2-4fab-bf43-3380fa33bcf6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:43.229503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bafde49f-afe2-4fab-bf43-3380fa33bcf6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:43.229954 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bafde49f-afe2-4fab-bf43-3380fa33bcf6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:43.230709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bafde49f-afe2-4fab-bf43-3380fa33bcf6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:43.231138 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bafde49f-afe2-4fab-bf43-3380fa33bcf6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:43.366595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bafde49f-afe2-4fab-bf43-3380fa33bcf6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:43.374600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bafde49f-afe2-4fab-bf43-3380fa33bcf6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.157203 Jul 27 20:20:43.375169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 369/738] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:43 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:43.735112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:43.735719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:43.743218 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:43.743664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:43.744438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:43.744875 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:43.748922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:43.875235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:43.884331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:43.886146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:43.887022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4bd25fbf-4c6f-4f60-a3dc-b8e59e965712 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155879 Jul 27 20:20:43.887701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 370/739] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:43 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:44.395139 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4c0cd2b9-e90e-4b7f-bbff-28475cbd7edc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:44.395743 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4c0cd2b9-e90e-4b7f-bbff-28475cbd7edc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:44.401973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c0cd2b9-e90e-4b7f-bbff-28475cbd7edc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:44.402419 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c0cd2b9-e90e-4b7f-bbff-28475cbd7edc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:44.403166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c0cd2b9-e90e-4b7f-bbff-28475cbd7edc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:44.403596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c0cd2b9-e90e-4b7f-bbff-28475cbd7edc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:44.539173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4c0cd2b9-e90e-4b7f-bbff-28475cbd7edc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:44.539173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4c0cd2b9-e90e-4b7f-bbff-28475cbd7edc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147208 Jul 27 20:20:44.539173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 370/740] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:44.910982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:44.911592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:44.918148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:44.918607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:44.919363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:44.919799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:45.049381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:45.058400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:45.059911 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:45.061125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd93d189-f45c-47bc-b28f-b5bf71ed91c9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154662 Jul 27 20:20:45.061695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 371/741] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:45.560095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-29cb68cf-3949-4bac-9922-89345e7be153 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:45.560803 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-29cb68cf-3949-4bac-9922-89345e7be153 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:45.567313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29cb68cf-3949-4bac-9922-89345e7be153 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:45.567759 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29cb68cf-3949-4bac-9922-89345e7be153 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:45.568551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29cb68cf-3949-4bac-9922-89345e7be153 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:45.568988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29cb68cf-3949-4bac-9922-89345e7be153 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:45.697551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-29cb68cf-3949-4bac-9922-89345e7be153 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:45.704975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-29cb68cf-3949-4bac-9922-89345e7be153 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148742 Jul 27 20:20:45.705551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 371/742] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:46.083505 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:46.084114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:46.090571 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:46.091017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:46.091772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:46.092205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:46.217959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:46.226962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:46.228497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:46.229648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-acf317ac-5b25-4e6c-937f-a74ae31a65a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150153 Jul 27 20:20:46.230209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 372/743] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:46 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:46.725695 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e8eeb7ac-28a2-4db2-8cd6-ea0953eff148 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:46.726308 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e8eeb7ac-28a2-4db2-8cd6-ea0953eff148 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:46.732802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8eeb7ac-28a2-4db2-8cd6-ea0953eff148 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:46.733255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8eeb7ac-28a2-4db2-8cd6-ea0953eff148 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:46.734009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8eeb7ac-28a2-4db2-8cd6-ea0953eff148 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:46.734447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8eeb7ac-28a2-4db2-8cd6-ea0953eff148 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:46.866434 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e8eeb7ac-28a2-4db2-8cd6-ea0953eff148 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:46.868607 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:46.874437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e8eeb7ac-28a2-4db2-8cd6-ea0953eff148 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152610 Jul 27 20:20:46.875004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 372/744] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:47.253301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:47.253954 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:47.260438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:47.260892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:47.261648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:47.262082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:47.390945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:47.399622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:47.401168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:47.402322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-83ed8fb2-18c9-435a-9764-3a531a48d267 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152977 Jul 27 20:20:47.402885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 373/745] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:47.896924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b1649f4f-98d2-49c0-afb3-65256ddbf64e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:47.897486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b1649f4f-98d2-49c0-afb3-65256ddbf64e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:47.904533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1649f4f-98d2-49c0-afb3-65256ddbf64e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:47.905013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1649f4f-98d2-49c0-afb3-65256ddbf64e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:47.905767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1649f4f-98d2-49c0-afb3-65256ddbf64e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:47.906202 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1649f4f-98d2-49c0-afb3-65256ddbf64e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:48.045274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b1649f4f-98d2-49c0-afb3-65256ddbf64e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:48.053291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b1649f4f-98d2-49c0-afb3-65256ddbf64e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.160855 Jul 27 20:20:48.053872 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 373/746] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:47 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:48.430292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:48.430919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:48.437420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:48.437899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:48.438663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:48.439097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:48.562501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:48.570649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:48.572156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:48.573333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c780712a-2837-4eca-9806-a40e37a0cf77 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.147031 Jul 27 20:20:48.573890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 374/747] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:48 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:49.074158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-718c0535-5e08-4c3e-9d35-9a540969bc2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:49.074775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-718c0535-5e08-4c3e-9d35-9a540969bc2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:49.081261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-718c0535-5e08-4c3e-9d35-9a540969bc2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:49.081790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-718c0535-5e08-4c3e-9d35-9a540969bc2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:49.082549 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-718c0535-5e08-4c3e-9d35-9a540969bc2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:49.082982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-718c0535-5e08-4c3e-9d35-9a540969bc2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:49.211952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-718c0535-5e08-4c3e-9d35-9a540969bc2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:49.219414 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-718c0535-5e08-4c3e-9d35-9a540969bc2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149151 Jul 27 20:20:49.219983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 374/748] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:49.596503 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:49.597131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:49.604122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:49.604596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:49.605373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:49.605795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:49.735044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:49.744226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:49.745689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:49.746825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6525dde5-818e-4252-b1cc-a9c57738560c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154266 Jul 27 20:20:49.747384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 375/749] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:20:50.240634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-81079278-6ff3-45ef-821e-a783e949c4e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:50.241242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-81079278-6ff3-45ef-821e-a783e949c4e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:50.247638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81079278-6ff3-45ef-821e-a783e949c4e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:50.248076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81079278-6ff3-45ef-821e-a783e949c4e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:50.248898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81079278-6ff3-45ef-821e-a783e949c4e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:50.249325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-81079278-6ff3-45ef-821e-a783e949c4e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:50.378247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-81079278-6ff3-45ef-821e-a783e949c4e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:50.386545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-81079278-6ff3-45ef-821e-a783e949c4e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150146 Jul 27 20:20:50.387109 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 375/750] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:50.769872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:50.770490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:50.776896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:50.777349 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:50.778110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:50.778546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:50.906777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:50.915746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:50.917292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:50.918435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c5665752-9acf-42b3-82ac-4d0260c5c1fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152998 Jul 27 20:20:50.918990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 376/751] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:50 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:51.408657 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3e3124ce-0c94-43cf-8956-4653af6dea30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:51.409498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3e3124ce-0c94-43cf-8956-4653af6dea30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:51.418416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e3124ce-0c94-43cf-8956-4653af6dea30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:51.419210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e3124ce-0c94-43cf-8956-4653af6dea30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:51.420428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e3124ce-0c94-43cf-8956-4653af6dea30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:51.420871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e3124ce-0c94-43cf-8956-4653af6dea30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:51.548470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3e3124ce-0c94-43cf-8956-4653af6dea30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:51.555817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3e3124ce-0c94-43cf-8956-4653af6dea30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151072 Jul 27 20:20:51.556399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 376/752] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:51.941434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:51.942051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:51.948705 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:51.949158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:51.949918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:51.950353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:52.079980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:52.088220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:52.089787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:52.090928 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1a55e74e-a70d-440d-885e-e44d0b4718cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153485 Jul 27 20:20:52.091485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 377/753] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:52.576998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-833cb0ae-833c-4f86-acf6-d84fc8327022 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:52.578040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-833cb0ae-833c-4f86-acf6-d84fc8327022 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:52.584685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-833cb0ae-833c-4f86-acf6-d84fc8327022 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:52.585122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-833cb0ae-833c-4f86-acf6-d84fc8327022 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:52.585864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-833cb0ae-833c-4f86-acf6-d84fc8327022 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:52.586288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-833cb0ae-833c-4f86-acf6-d84fc8327022 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:52.713108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-833cb0ae-833c-4f86-acf6-d84fc8327022 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:52.720664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-833cb0ae-833c-4f86-acf6-d84fc8327022 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147450 Jul 27 20:20:52.721236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 377/754] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:53.114300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:53.114906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:53.121261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:53.121705 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:53.122451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:53.122882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:53.246249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:53.255054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:53.256582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:53.257729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7f447e60-bf60-41cb-bdfa-b47bcec1fdd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.147583 Jul 27 20:20:53.258283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 378/755] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:53 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:53.742961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5ee61482-a738-4b0a-b37c-fecfce97796a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:53.743586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5ee61482-a738-4b0a-b37c-fecfce97796a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:53.747072 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=52 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:53.752897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5ee61482-a738-4b0a-b37c-fecfce97796a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:53.754014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5ee61482-a738-4b0a-b37c-fecfce97796a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:53.758989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5ee61482-a738-4b0a-b37c-fecfce97796a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:53.758989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5ee61482-a738-4b0a-b37c-fecfce97796a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:53.885664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5ee61482-a738-4b0a-b37c-fecfce97796a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:53.893086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5ee61482-a738-4b0a-b37c-fecfce97796a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153921 Jul 27 20:20:53.893865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 378/756] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:54.280286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:54.280966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:54.287911 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:54.288356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:54.289139 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:54.289572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:54.417780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:54.426121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:54.427633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:54.428830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-615371b8-13df-4207-8e4d-6ecb74549ff2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152398 Jul 27 20:20:54.429396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 379/757] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:54 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:54.914007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c2fbcc78-cb8a-4eba-b859-7715bbd8d6c7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:54.914640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c2fbcc78-cb8a-4eba-b859-7715bbd8d6c7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:54.921051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2fbcc78-cb8a-4eba-b859-7715bbd8d6c7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:54.921492 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2fbcc78-cb8a-4eba-b859-7715bbd8d6c7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:54.922234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2fbcc78-cb8a-4eba-b859-7715bbd8d6c7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:54.922658 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2fbcc78-cb8a-4eba-b859-7715bbd8d6c7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:55.054376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c2fbcc78-cb8a-4eba-b859-7715bbd8d6c7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:55.061718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c2fbcc78-cb8a-4eba-b859-7715bbd8d6c7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151578 Jul 27 20:20:55.062278 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 379/758] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:54 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:55.451765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:55.452363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:55.454200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=54 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:55.459618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:55.460071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:55.460949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:55.461417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:55.733008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:55.742250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:55.743770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:55.744956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5a8a3103-8c84-47aa-a1fc-5bd50bc0b2e3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.297287 Jul 27 20:20:55.745525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 380/759] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:55 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:56.083358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6e3e2995-da5d-4a4a-b9ec-8e2cc679adf2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:56.083971 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6e3e2995-da5d-4a4a-b9ec-8e2cc679adf2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:56.090497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e3e2995-da5d-4a4a-b9ec-8e2cc679adf2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:56.090984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e3e2995-da5d-4a4a-b9ec-8e2cc679adf2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:56.091742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e3e2995-da5d-4a4a-b9ec-8e2cc679adf2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:56.092178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e3e2995-da5d-4a4a-b9ec-8e2cc679adf2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:56.218331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6e3e2995-da5d-4a4a-b9ec-8e2cc679adf2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:56.226365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6e3e2995-da5d-4a4a-b9ec-8e2cc679adf2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147492 Jul 27 20:20:56.226934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 380/760] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:56.767571 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:56.768213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:56.774614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:56.775063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:56.775874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:56.776304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:56.906516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:56.915188 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:56.916696 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:56.917846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c8bc8533-380d-495f-969f-d0499c5a78d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154188 Jul 27 20:20:56.918478 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 381/761] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:57.247015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8fdea777-0c8d-4a40-9389-557321d7441b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:57.247616 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8fdea777-0c8d-4a40-9389-557321d7441b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:57.254118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fdea777-0c8d-4a40-9389-557321d7441b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:57.254566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fdea777-0c8d-4a40-9389-557321d7441b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:57.255326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fdea777-0c8d-4a40-9389-557321d7441b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:57.255760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fdea777-0c8d-4a40-9389-557321d7441b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:57.385711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8fdea777-0c8d-4a40-9389-557321d7441b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:57.393299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8fdea777-0c8d-4a40-9389-557321d7441b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150188 Jul 27 20:20:57.394393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 381/762] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:57.941122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:57.941726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:57.948104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:57.948583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:57.949327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:57.949752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:58.080118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:58.088513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:58.090000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:58.091134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a17a8a30-4a11-443e-9079-406909949785 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153972 Jul 27 20:20:58.091688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 382/763] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:58.415606 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-12e5f202-f740-4b20-bdf8-e6886fd52357 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:58.416243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-12e5f202-f740-4b20-bdf8-e6886fd52357 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:58.422815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-12e5f202-f740-4b20-bdf8-e6886fd52357 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:58.423263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-12e5f202-f740-4b20-bdf8-e6886fd52357 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:58.424017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-12e5f202-f740-4b20-bdf8-e6886fd52357 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:58.424472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-12e5f202-f740-4b20-bdf8-e6886fd52357 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:58.553132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-12e5f202-f740-4b20-bdf8-e6886fd52357 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:58.560531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-12e5f202-f740-4b20-bdf8-e6886fd52357 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148688 Jul 27 20:20:58.561089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 382/764] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:20:59.114510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:59.115108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:59.121438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:59.121879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:59.122619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:59.123045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:59.250811 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:59.259499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:59.261029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:59.262163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-467071a1-0977-4dc0-9ce5-aa73cdbf00eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151928 Jul 27 20:20:59.262706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 383/765] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:20:59 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:20:59.582310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-76aeefd5-ace3-457c-a9d1-d17298bee03a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:20:59.582913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-76aeefd5-ace3-457c-a9d1-d17298bee03a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:20:59.589344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76aeefd5-ace3-457c-a9d1-d17298bee03a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:59.589787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76aeefd5-ace3-457c-a9d1-d17298bee03a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:59.590529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76aeefd5-ace3-457c-a9d1-d17298bee03a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:20:59.590968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76aeefd5-ace3-457c-a9d1-d17298bee03a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:20:59.720198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-76aeefd5-ace3-457c-a9d1-d17298bee03a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:20:59.727587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-76aeefd5-ace3-457c-a9d1-d17298bee03a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149218 Jul 27 20:20:59.728241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 383/766] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:20:59 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:00.286013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:00.286615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:00.293143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.293589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.294339 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.294767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.425020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:00.433328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:00.434818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:00.435961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-da07e58d-c756-442d-80bb-c6bb4cb927f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154304 Jul 27 20:21:00.436552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 384/767] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:00 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:00.749866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3eeffe0c-4d23-41d6-955f-c98f8d3a0ca3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:00.750472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3eeffe0c-4d23-41d6-955f-c98f8d3a0ca3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:00.757531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3eeffe0c-4d23-41d6-955f-c98f8d3a0ca3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.757952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3eeffe0c-4d23-41d6-955f-c98f8d3a0ca3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.758693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3eeffe0c-4d23-41d6-955f-c98f8d3a0ca3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.759118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3eeffe0c-4d23-41d6-955f-c98f8d3a0ca3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.900900 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3eeffe0c-4d23-41d6-955f-c98f8d3a0ca3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:00.908287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3eeffe0c-4d23-41d6-955f-c98f8d3a0ca3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.162232 Jul 27 20:21:00.908893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 384/768] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:01.459589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:01.460199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:01.466703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:01.467151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:01.467926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:01.468364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:01.592572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:01.601263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:01.602769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:01.603912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bd7c4482-362b-49f9-8032-2516c02ead75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148750 Jul 27 20:21:01.604494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 385/769] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:01.929963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8212e89c-367f-4750-b825-79684e78f858 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:01.930679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8212e89c-367f-4750-b825-79684e78f858 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:01.937183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8212e89c-367f-4750-b825-79684e78f858 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:01.937634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8212e89c-367f-4750-b825-79684e78f858 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:01.938387 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8212e89c-367f-4750-b825-79684e78f858 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:01.938823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8212e89c-367f-4750-b825-79684e78f858 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:02.074940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8212e89c-367f-4750-b825-79684e78f858 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:02.083625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8212e89c-367f-4750-b825-79684e78f858 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.157513 Jul 27 20:21:02.084230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 385/770] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:01 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:02.627487 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:02.628073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:02.634448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:02.634890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:02.635634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:02.636059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:02.762552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:02.765864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:02.771425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:02.772978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:02.774109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8137c1ea-1074-4da5-8186-95df5116221c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150640 Jul 27 20:21:02.774655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 386/771] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:02 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:03.105232 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1d05ac7f-8e49-494f-b2f3-d0b751c73211 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:03.105833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1d05ac7f-8e49-494f-b2f3-d0b751c73211 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:03.113174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1d05ac7f-8e49-494f-b2f3-d0b751c73211 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:03.113614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1d05ac7f-8e49-494f-b2f3-d0b751c73211 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:03.114359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1d05ac7f-8e49-494f-b2f3-d0b751c73211 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:03.114787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1d05ac7f-8e49-494f-b2f3-d0b751c73211 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:03.241589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1d05ac7f-8e49-494f-b2f3-d0b751c73211 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:03.249074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1d05ac7f-8e49-494f-b2f3-d0b751c73211 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147649 Jul 27 20:21:03.249642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 386/772] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:03.797145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:03.797751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:03.804699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:03.805148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:03.805903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:03.806340 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:03.936162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:03.944898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:03.946392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:03.947534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-29f3b306-392d-4860-86d7-3af0b355b2cc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154252 Jul 27 20:21:03.948087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 387/773] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:04.269713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-712cfc0f-8267-4ca8-bddd-bf5aa7161812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:04.270322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-712cfc0f-8267-4ca8-bddd-bf5aa7161812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:04.276877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-712cfc0f-8267-4ca8-bddd-bf5aa7161812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:04.277323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-712cfc0f-8267-4ca8-bddd-bf5aa7161812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:04.278073 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-712cfc0f-8267-4ca8-bddd-bf5aa7161812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:04.278500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-712cfc0f-8267-4ca8-bddd-bf5aa7161812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:04.410024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-712cfc0f-8267-4ca8-bddd-bf5aa7161812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:04.417431 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-712cfc0f-8267-4ca8-bddd-bf5aa7161812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151576 Jul 27 20:21:04.417997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 387/774] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:21:04.971976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:04.972613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:04.979078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:04.979528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:04.980296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:04.980769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:05.114206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:05.122572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:05.124072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:05.125246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-11c74359-235a-43fb-a469-e4d289444c2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.157821 Jul 27 20:21:05.125813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 388/775] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:04 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:05.439049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-190f30d1-27a1-457a-a74e-19faea6b0568 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:05.439695 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-190f30d1-27a1-457a-a74e-19faea6b0568 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:05.446756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-190f30d1-27a1-457a-a74e-19faea6b0568 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:05.447211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-190f30d1-27a1-457a-a74e-19faea6b0568 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:05.447964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-190f30d1-27a1-457a-a74e-19faea6b0568 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:05.448429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-190f30d1-27a1-457a-a74e-19faea6b0568 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:05.575151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-190f30d1-27a1-457a-a74e-19faea6b0568 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:05.582762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-190f30d1-27a1-457a-a74e-19faea6b0568 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147649 Jul 27 20:21:05.583331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 388/776] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:06.147930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:06.148579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:06.155045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:06.155442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:06.156199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:06.156677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:06.283083 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:06.291860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:06.293396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:06.294545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-210c72b1-1137-4a7e-8d61-89b74294f4da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150539 Jul 27 20:21:06.295108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 389/777] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:06 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:06.603877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dfcf1806-b70b-4893-b784-432d76d9d4c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:06.604520 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dfcf1806-b70b-4893-b784-432d76d9d4c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:06.611238 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dfcf1806-b70b-4893-b784-432d76d9d4c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:06.611694 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dfcf1806-b70b-4893-b784-432d76d9d4c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:06.612479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dfcf1806-b70b-4893-b784-432d76d9d4c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:06.612925 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dfcf1806-b70b-4893-b784-432d76d9d4c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:06.627496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:06.742689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dfcf1806-b70b-4893-b784-432d76d9d4c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:06.750073 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dfcf1806-b70b-4893-b784-432d76d9d4c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150257 Jul 27 20:21:06.750643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 389/778] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:07.318192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:07.318822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:07.325242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:07.325688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:07.326428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:07.326848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:07.451910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:07.460655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:07.462147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:07.463274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c82dfcee-0766-4c3a-b692-518251cf22b6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149333 Jul 27 20:21:07.463829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 390/779] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:07 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:07.770724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-11e3edcf-53b1-46cb-9c0a-73f626f733de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:07.771381 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-11e3edcf-53b1-46cb-9c0a-73f626f733de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:07.777641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11e3edcf-53b1-46cb-9c0a-73f626f733de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:07.778083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11e3edcf-53b1-46cb-9c0a-73f626f733de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:07.778827 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11e3edcf-53b1-46cb-9c0a-73f626f733de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:07.779252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11e3edcf-53b1-46cb-9c0a-73f626f733de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:07.910542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-11e3edcf-53b1-46cb-9c0a-73f626f733de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:07.917978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-11e3edcf-53b1-46cb-9c0a-73f626f733de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151125 Jul 27 20:21:07.918538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 390/780] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:08.486466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:08.487072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:08.493559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:08.494002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:08.494752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:08.495178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:08.621033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:08.629235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:08.630733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:08.631879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f63289fc-4e69-4c3a-8b8c-2b23da9117ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149584 Jul 27 20:21:08.632452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 391/781] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:08 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:08.939192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-75f00177-c7d9-40f2-b40f-821f84ca8bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:08.939739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-75f00177-c7d9-40f2-b40f-821f84ca8bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:08.946283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75f00177-c7d9-40f2-b40f-821f84ca8bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:08.946726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75f00177-c7d9-40f2-b40f-821f84ca8bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:08.947485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75f00177-c7d9-40f2-b40f-821f84ca8bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:08.947918 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75f00177-c7d9-40f2-b40f-821f84ca8bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:09.078810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-75f00177-c7d9-40f2-b40f-821f84ca8bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:09.086322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-75f00177-c7d9-40f2-b40f-821f84ca8bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151201 Jul 27 20:21:09.086892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 391/782] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:08 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:09.655129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:09.655693 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:09.662830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:09.663286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:09.664044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:09.664519 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:09.794779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:09.803165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:09.804701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:09.805853 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-53612688-7201-4ee2-9729-217dfc85dd50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154832 Jul 27 20:21:09.806414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 392/783] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:10.108152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-74539cf5-c24e-449d-8f02-05f535fbbbe2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:10.108802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-74539cf5-c24e-449d-8f02-05f535fbbbe2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:10.115514 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74539cf5-c24e-449d-8f02-05f535fbbbe2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:10.115964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74539cf5-c24e-449d-8f02-05f535fbbbe2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:10.116748 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74539cf5-c24e-449d-8f02-05f535fbbbe2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:10.117187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74539cf5-c24e-449d-8f02-05f535fbbbe2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:10.243488 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-74539cf5-c24e-449d-8f02-05f535fbbbe2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:10.250952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-74539cf5-c24e-449d-8f02-05f535fbbbe2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.146677 Jul 27 20:21:10.251526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 392/784] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:21:10.829421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:10.830013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:10.837033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:10.837474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:10.838215 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:10.838664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:10.968096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:10.977208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:10.979231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:10.980441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4c5aa571-f1ff-4dd1-ae77-d533a1c40d0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154837 Jul 27 20:21:10.981004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 393/785] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:11.273147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aa00fa2d-ecea-4b2b-8425-e5b623302486 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:11.273761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aa00fa2d-ecea-4b2b-8425-e5b623302486 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:11.280223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa00fa2d-ecea-4b2b-8425-e5b623302486 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:11.280707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa00fa2d-ecea-4b2b-8425-e5b623302486 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:11.281469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa00fa2d-ecea-4b2b-8425-e5b623302486 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:11.281906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa00fa2d-ecea-4b2b-8425-e5b623302486 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:11.409736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aa00fa2d-ecea-4b2b-8425-e5b623302486 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:11.417134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aa00fa2d-ecea-4b2b-8425-e5b623302486 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148462 Jul 27 20:21:11.417706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 393/786] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:12.004005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:12.004646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:12.011101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:12.011552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:12.012424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:12.012867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:12.145060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:12.153526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:12.154977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:12.156115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-be6c4658-336d-4f8b-a815-7900773d04a6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156842 Jul 27 20:21:12.156714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 394/787] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:11 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:12.438181 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-30738485-1314-46ce-a166-7d6ebe7fbce5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:12.438736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-30738485-1314-46ce-a166-7d6ebe7fbce5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:12.445379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30738485-1314-46ce-a166-7d6ebe7fbce5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:12.445833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30738485-1314-46ce-a166-7d6ebe7fbce5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:12.446589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30738485-1314-46ce-a166-7d6ebe7fbce5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:12.447024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30738485-1314-46ce-a166-7d6ebe7fbce5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:12.575761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-30738485-1314-46ce-a166-7d6ebe7fbce5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:12.583660 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-30738485-1314-46ce-a166-7d6ebe7fbce5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149417 Jul 27 20:21:12.584227 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 394/788] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:13.179256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:13.179876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:13.186474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:13.186922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:13.187680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:13.188113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:13.316014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:13.324342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:13.325879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:13.327035 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b351bd9b-f4f4-41c8-bff4-f6166cffc4f9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151767 Jul 27 20:21:13.327591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 395/789] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:13 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:13.605548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f8be5827-4814-407c-ad89-45f468987c93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:13.606165 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f8be5827-4814-407c-ad89-45f468987c93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:13.613524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8be5827-4814-407c-ad89-45f468987c93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:13.613973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8be5827-4814-407c-ad89-45f468987c93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:13.614730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8be5827-4814-407c-ad89-45f468987c93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:13.615164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8be5827-4814-407c-ad89-45f468987c93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:13.743350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f8be5827-4814-407c-ad89-45f468987c93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:13.750724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f8be5827-4814-407c-ad89-45f468987c93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149080 Jul 27 20:21:13.751286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 395/790] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:14.351261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:14.351872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:14.358354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:14.358806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:14.359563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:14.359994 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:14.488696 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:14.500369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:14.501885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:14.503026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-49e31985-bf2d-4ba5-8d08-6a2cbe3a1885 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156286 Jul 27 20:21:14.503596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 396/791] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:14 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:14.772631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e63bf412-bbe2-4509-8dbf-3a8d74940b9c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:14.773237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e63bf412-bbe2-4509-8dbf-3a8d74940b9c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:14.779559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e63bf412-bbe2-4509-8dbf-3a8d74940b9c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:14.780310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e63bf412-bbe2-4509-8dbf-3a8d74940b9c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:14.781641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e63bf412-bbe2-4509-8dbf-3a8d74940b9c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:14.782362 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e63bf412-bbe2-4509-8dbf-3a8d74940b9c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:14.914973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e63bf412-bbe2-4509-8dbf-3a8d74940b9c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:14.922370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e63bf412-bbe2-4509-8dbf-3a8d74940b9c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.154376 Jul 27 20:21:14.922933 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 396/792] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:15.525633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:15.526348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:15.532936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:15.533379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:15.534130 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:15.535231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:15.660668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:15.668934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:15.670447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:15.671593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2d43acf9-853a-4553-af2a-226a5cb1744f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149838 Jul 27 20:21:15.672154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 397/793] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:15.943488 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8d4fd5e0-fc67-45f1-9d15-cb31ccd84ba2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:15.944093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8d4fd5e0-fc67-45f1-9d15-cb31ccd84ba2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:15.950482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d4fd5e0-fc67-45f1-9d15-cb31ccd84ba2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:15.950918 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d4fd5e0-fc67-45f1-9d15-cb31ccd84ba2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:15.951661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d4fd5e0-fc67-45f1-9d15-cb31ccd84ba2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:15.952089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d4fd5e0-fc67-45f1-9d15-cb31ccd84ba2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:16.083381 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8d4fd5e0-fc67-45f1-9d15-cb31ccd84ba2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:16.090809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8d4fd5e0-fc67-45f1-9d15-cb31ccd84ba2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151698 Jul 27 20:21:16.091371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 397/794] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:15 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:16.694286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:16.694888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:16.701347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:16.701789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:16.702530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:16.702953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:16.830670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:16.839551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:16.841096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:16.842234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c98c5be7-e445-47a8-a041-53a66bebe8a7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151958 Jul 27 20:21:16.842785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 398/795] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:16 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:17.113189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4fe1d7dc-079d-44d1-9668-3d9cf4a23bdb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:17.113714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4fe1d7dc-079d-44d1-9668-3d9cf4a23bdb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:17.120150 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4fe1d7dc-079d-44d1-9668-3d9cf4a23bdb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:17.120714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4fe1d7dc-079d-44d1-9668-3d9cf4a23bdb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:17.121477 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4fe1d7dc-079d-44d1-9668-3d9cf4a23bdb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:17.121918 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4fe1d7dc-079d-44d1-9668-3d9cf4a23bdb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:17.249852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4fe1d7dc-079d-44d1-9668-3d9cf4a23bdb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:17.257462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4fe1d7dc-079d-44d1-9668-3d9cf4a23bdb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148988 Jul 27 20:21:17.258034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 398/796] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:17.865103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:17.865748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:17.872124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:17.872611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:17.873361 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:17.873792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:18.001374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:18.010111 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:18.011607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:18.012793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6f13a727-30b7-455f-9842-ceeee09236fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151597 Jul 27 20:21:18.013378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 399/797] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:18.278010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-013f4bed-6f8e-44f0-a52a-23d2789380c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:18.278625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-013f4bed-6f8e-44f0-a52a-23d2789380c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:18.285611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-013f4bed-6f8e-44f0-a52a-23d2789380c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:18.286058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-013f4bed-6f8e-44f0-a52a-23d2789380c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:18.286815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-013f4bed-6f8e-44f0-a52a-23d2789380c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:18.287251 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-013f4bed-6f8e-44f0-a52a-23d2789380c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:18.415546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-013f4bed-6f8e-44f0-a52a-23d2789380c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:18.423037 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-013f4bed-6f8e-44f0-a52a-23d2789380c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148971 Jul 27 20:21:18.423602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 399/798] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:19.036223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:19.036890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:19.044490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:19.044945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:19.045704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:19.046139 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:19.182681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:19.192185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:19.193827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:19.194980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-612e68da-ca46-499a-a552-57065d6f8eb9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.163225 Jul 27 20:21:19.195533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 400/799] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:19 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:19.445579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e1915c6b-0a95-439f-aaaa-d3d7c79f27c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:19.446104 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e1915c6b-0a95-439f-aaaa-d3d7c79f27c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:19.452687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1915c6b-0a95-439f-aaaa-d3d7c79f27c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:19.455487 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1915c6b-0a95-439f-aaaa-d3d7c79f27c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:19.455487 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1915c6b-0a95-439f-aaaa-d3d7c79f27c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:19.455487 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1915c6b-0a95-439f-aaaa-d3d7c79f27c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:19.583371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e1915c6b-0a95-439f-aaaa-d3d7c79f27c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:19.590828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e1915c6b-0a95-439f-aaaa-d3d7c79f27c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149199 Jul 27 20:21:19.591394 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 400/800] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:20.218937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:20.219495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:20.226392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:20.226841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:20.227631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:20.228064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:20.359310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:20.368039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:20.372029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:20.372029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-43c980a0-db91-48e0-8446-be07d616f99f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155841 Jul 27 20:21:20.372029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 401/801] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:20 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:20.613066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1c61aafa-b8a6-4ba8-9fc3-50b42b901aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:20.613681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1c61aafa-b8a6-4ba8-9fc3-50b42b901aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:20.620339 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c61aafa-b8a6-4ba8-9fc3-50b42b901aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:20.620819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c61aafa-b8a6-4ba8-9fc3-50b42b901aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:20.621581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c61aafa-b8a6-4ba8-9fc3-50b42b901aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:20.622019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c61aafa-b8a6-4ba8-9fc3-50b42b901aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:20.751746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1c61aafa-b8a6-4ba8-9fc3-50b42b901aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:20.759843 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1c61aafa-b8a6-4ba8-9fc3-50b42b901aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150970 Jul 27 20:21:20.760435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 401/802] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:21.394727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:21.395385 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:21.401955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:21.402402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:21.403154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:21.403584 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:21.527267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:21.536515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:21.538069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:21.539219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f13d5259-4112-454b-8701-7e0f2cab3d09 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148877 Jul 27 20:21:21.539789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 402/803] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:21.780827 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-75a685ff-811f-4abd-a24f-f6524af05132 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:21.781429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-75a685ff-811f-4abd-a24f-f6524af05132 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:21.788361 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75a685ff-811f-4abd-a24f-f6524af05132 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:21.788837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75a685ff-811f-4abd-a24f-f6524af05132 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:21.789577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75a685ff-811f-4abd-a24f-f6524af05132 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:21.790005 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75a685ff-811f-4abd-a24f-f6524af05132 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:21.920548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-75a685ff-811f-4abd-a24f-f6524af05132 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:21.928017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-75a685ff-811f-4abd-a24f-f6524af05132 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150932 Jul 27 20:21:21.928607 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 402/804] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:22.561855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:22.562513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:22.569113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:22.569552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:22.570292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:22.570717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:22.587953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:22.695868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:22.704154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:22.705741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:22.706883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a0840f65-f743-4bb7-b764-df1d4bcf4081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149028 Jul 27 20:21:22.707444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 403/805] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:22.951160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cde854cb-5105-46b9-8c71-3342e299fac9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:22.951679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cde854cb-5105-46b9-8c71-3342e299fac9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:22.958900 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cde854cb-5105-46b9-8c71-3342e299fac9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:22.959352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cde854cb-5105-46b9-8c71-3342e299fac9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:22.960117 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cde854cb-5105-46b9-8c71-3342e299fac9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:22.960592 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cde854cb-5105-46b9-8c71-3342e299fac9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:23.092226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cde854cb-5105-46b9-8c71-3342e299fac9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:23.100325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cde854cb-5105-46b9-8c71-3342e299fac9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153187 Jul 27 20:21:23.100923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 403/806] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:21:23.729460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:23.730075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:23.736840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:23.737298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:23.738053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:23.738494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:23.867772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:23.876197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:23.877900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:23.879047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5c9a2445-7a3a-472b-ad61-d2f52af7897b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153666 Jul 27 20:21:23.879610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 404/807] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:23 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:24.121950 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-caf0df5b-a75f-453b-ab7f-d349518c541a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:24.122481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-caf0df5b-a75f-453b-ab7f-d349518c541a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:24.124784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=52 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:24.129470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caf0df5b-a75f-453b-ab7f-d349518c541a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:24.129917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caf0df5b-a75f-453b-ab7f-d349518c541a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:24.130669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caf0df5b-a75f-453b-ab7f-d349518c541a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:24.131102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caf0df5b-a75f-453b-ab7f-d349518c541a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:24.258137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-caf0df5b-a75f-453b-ab7f-d349518c541a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:24.265659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-caf0df5b-a75f-453b-ab7f-d349518c541a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147662 Jul 27 20:21:24.266223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 404/808] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:24.902679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:24.903288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:24.909525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:24.909977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:24.910735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:24.911172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:25.039962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:25.048232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:25.050359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:25.051529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ca110ba-3fec-46fb-87c7-c3a2fd5736c7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152708 Jul 27 20:21:25.052088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 405/809] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:24 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:25.287315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-97489d55-77b6-402d-95db-b62c696a96cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:25.287947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-97489d55-77b6-402d-95db-b62c696a96cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:25.294407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97489d55-77b6-402d-95db-b62c696a96cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:25.294849 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97489d55-77b6-402d-95db-b62c696a96cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:25.295596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97489d55-77b6-402d-95db-b62c696a96cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:25.296027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97489d55-77b6-402d-95db-b62c696a96cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:25.461118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-97489d55-77b6-402d-95db-b62c696a96cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:25.468823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-97489d55-77b6-402d-95db-b62c696a96cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.185948 Jul 27 20:21:25.469407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 405/810] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:26.074554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:26.075166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:26.077598 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=52 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:26.082825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:26.083279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:26.084035 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:26.084512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:26.213757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:26.222573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:26.224101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:26.225283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-077aec23-7c4d-4681-91f2-8f4b5ebd6dc9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155124 Jul 27 20:21:26.225842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 406/811] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:26 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:26.491080 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f607928b-2862-44b9-b27f-098e33f7c93e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:26.492711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f607928b-2862-44b9-b27f-098e33f7c93e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:26.499641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f607928b-2862-44b9-b27f-098e33f7c93e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:26.500089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f607928b-2862-44b9-b27f-098e33f7c93e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:26.504019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f607928b-2862-44b9-b27f-098e33f7c93e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:26.504019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f607928b-2862-44b9-b27f-098e33f7c93e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:26.505206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:26.629084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f607928b-2862-44b9-b27f-098e33f7c93e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:26.636419 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f607928b-2862-44b9-b27f-098e33f7c93e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149750 Jul 27 20:21:26.636994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 406/812] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:27.249621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:27.250223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:27.257159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:27.257599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:27.258342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:27.258766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:27.394762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:27.404283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:27.405907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:27.407457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-32ca919d-7e7b-4aa5-945c-25174e770982 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.161556 Jul 27 20:21:27.408411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 407/813] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:27 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:27.658023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4fab643d-fa6c-4b57-a144-59dd82e5b0ce tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:27.658552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4fab643d-fa6c-4b57-a144-59dd82e5b0ce tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:27.665706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4fab643d-fa6c-4b57-a144-59dd82e5b0ce tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:27.666155 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4fab643d-fa6c-4b57-a144-59dd82e5b0ce tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:27.666909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4fab643d-fa6c-4b57-a144-59dd82e5b0ce tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:27.667344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4fab643d-fa6c-4b57-a144-59dd82e5b0ce tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:27.795216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4fab643d-fa6c-4b57-a144-59dd82e5b0ce tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:27.803266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4fab643d-fa6c-4b57-a144-59dd82e5b0ce tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149195 Jul 27 20:21:27.803834 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 407/814] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:27 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:28.433891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:28.434500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:28.441508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:28.441968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:28.442726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:28.443160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:28.570498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:28.578730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:28.580241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:28.581411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d9321176-e3fb-407f-8d8d-dedac35ca7d8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151428 Jul 27 20:21:28.582648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 408/815] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:28 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:28.824576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3c39d4c0-be72-40ab-a062-776e1b4eda56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:28.825184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3c39d4c0-be72-40ab-a062-776e1b4eda56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:28.831575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c39d4c0-be72-40ab-a062-776e1b4eda56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:28.832076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c39d4c0-be72-40ab-a062-776e1b4eda56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:28.832908 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c39d4c0-be72-40ab-a062-776e1b4eda56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:28.833339 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c39d4c0-be72-40ab-a062-776e1b4eda56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:28.958176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3c39d4c0-be72-40ab-a062-776e1b4eda56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:28.965592 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3c39d4c0-be72-40ab-a062-776e1b4eda56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.144865 Jul 27 20:21:28.966163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 408/816] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:29.605360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:29.605890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:29.612550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:29.613613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:29.614376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:29.614809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:29.743003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:29.751307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:29.752846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:29.754605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0c857150-3f37-437f-90c7-87bc08334725 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153237 Jul 27 20:21:29.755202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 409/817] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:29 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:29.986141 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e059f360-9087-48eb-82b7-9984a5379978 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:29.986753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e059f360-9087-48eb-82b7-9984a5379978 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:29.994003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e059f360-9087-48eb-82b7-9984a5379978 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:29.994453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e059f360-9087-48eb-82b7-9984a5379978 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:29.995211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e059f360-9087-48eb-82b7-9984a5379978 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:29.995648 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e059f360-9087-48eb-82b7-9984a5379978 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:30.363133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e059f360-9087-48eb-82b7-9984a5379978 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:30.370560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e059f360-9087-48eb-82b7-9984a5379978 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.388527 Jul 27 20:21:30.371129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 409/818] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:30.777387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:30.777985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:30.784374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:30.784953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:30.785692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:30.786117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:30.911134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:30.919621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:30.921173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:30.922329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7be706a3-4e21-469e-bb3b-623d860f326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148858 Jul 27 20:21:30.922886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 410/819] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:31.391024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-69445018-d225-404d-9975-66d66a23a9f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:31.391637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-69445018-d225-404d-9975-66d66a23a9f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:31.398628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69445018-d225-404d-9975-66d66a23a9f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:31.399078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69445018-d225-404d-9975-66d66a23a9f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:31.399836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69445018-d225-404d-9975-66d66a23a9f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:31.400273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69445018-d225-404d-9975-66d66a23a9f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:31.527906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-69445018-d225-404d-9975-66d66a23a9f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:31.535379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-69445018-d225-404d-9975-66d66a23a9f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148193 Jul 27 20:21:31.535951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 410/820] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:31.946268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:31.946917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:31.953320 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:31.953765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:31.954511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:31.954938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:32.082360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:32.090539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:32.092083 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:32.093240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b1b114bb-60d7-425b-91d3-e74c58dfe498 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150904 Jul 27 20:21:32.093797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 411/821] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:31 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:32.557039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b8de714b-6531-49de-883d-c627225cdec4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:32.557648 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b8de714b-6531-49de-883d-c627225cdec4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:32.564233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8de714b-6531-49de-883d-c627225cdec4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:32.564714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8de714b-6531-49de-883d-c627225cdec4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:32.565474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8de714b-6531-49de-883d-c627225cdec4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:32.566597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8de714b-6531-49de-883d-c627225cdec4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:32.699462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b8de714b-6531-49de-883d-c627225cdec4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:32.707043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b8de714b-6531-49de-883d-c627225cdec4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153842 Jul 27 20:21:32.707618 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 411/822] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:33.116578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:33.117186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:33.123880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:33.124325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:33.125219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:33.125652 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:33.253898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:33.264257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:33.265761 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:33.267103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-feebff48-490f-43a3-8bc5-d66a85baebd4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154513 Jul 27 20:21:33.267661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 412/823] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:33 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:33.728825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b9a24068-3db3-4003-ad83-7feb8d122525 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:33.729439 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b9a24068-3db3-4003-ad83-7feb8d122525 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:33.736102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9a24068-3db3-4003-ad83-7feb8d122525 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:33.736598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9a24068-3db3-4003-ad83-7feb8d122525 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:33.737353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9a24068-3db3-4003-ad83-7feb8d122525 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:33.738459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9a24068-3db3-4003-ad83-7feb8d122525 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:33.865265 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b9a24068-3db3-4003-ad83-7feb8d122525 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:33.872640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b9a24068-3db3-4003-ad83-7feb8d122525 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147702 Jul 27 20:21:33.873208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 412/824] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:33 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:34.293263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:34.293799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:34.300187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:34.300944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:34.302216 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:34.302967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:34.434420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:34.443264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:34.444818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:34.445972 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c7e66e3d-6fe8-4726-81f3-0290d1a9a6df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156713 Jul 27 20:21:34.446529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 413/825] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:34.893614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c72a03ff-71dd-4197-b6f1-74dc48fccac7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:34.894264 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c72a03ff-71dd-4197-b6f1-74dc48fccac7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:34.900784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c72a03ff-71dd-4197-b6f1-74dc48fccac7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:34.901235 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c72a03ff-71dd-4197-b6f1-74dc48fccac7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:34.901995 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c72a03ff-71dd-4197-b6f1-74dc48fccac7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:34.902430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c72a03ff-71dd-4197-b6f1-74dc48fccac7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:35.028229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c72a03ff-71dd-4197-b6f1-74dc48fccac7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:35.035654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c72a03ff-71dd-4197-b6f1-74dc48fccac7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.145928 Jul 27 20:21:35.036228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 413/826] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:35.469404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:35.470008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:35.476922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:35.477365 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:35.478135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:35.478581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:35.606476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:35.615775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:35.617311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:35.618449 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b273778c-2787-4b50-836b-6bdb57962ef3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152978 Jul 27 20:21:35.619012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 414/827] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:35 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:36.056166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a4bcca2f-78cc-4d3b-ab4a-6f3881e905bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:36.056823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a4bcca2f-78cc-4d3b-ab4a-6f3881e905bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:36.063196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4bcca2f-78cc-4d3b-ab4a-6f3881e905bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:36.063640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4bcca2f-78cc-4d3b-ab4a-6f3881e905bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:36.064396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4bcca2f-78cc-4d3b-ab4a-6f3881e905bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:36.064834 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4bcca2f-78cc-4d3b-ab4a-6f3881e905bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:36.194196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a4bcca2f-78cc-4d3b-ab4a-6f3881e905bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:36.201703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a4bcca2f-78cc-4d3b-ab4a-6f3881e905bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149430 Jul 27 20:21:36.205554 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 414/828] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:36.640900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:36.641514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:36.648053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:36.648540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:36.649303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:36.649743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:36.773380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:36.781676 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:36.783201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:36.784892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4eeeba79-8894-4983-828d-0c83790c1e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.147341 Jul 27 20:21:36.785457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 415/829] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:36 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:37.408696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7a3e9703-c847-4340-a34a-c21fe24841d4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:37.409885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7a3e9703-c847-4340-a34a-c21fe24841d4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:37.415847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a3e9703-c847-4340-a34a-c21fe24841d4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:37.416294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a3e9703-c847-4340-a34a-c21fe24841d4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:37.417084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a3e9703-c847-4340-a34a-c21fe24841d4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:37.417523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a3e9703-c847-4340-a34a-c21fe24841d4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:37.547172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7a3e9703-c847-4340-a34a-c21fe24841d4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:37.555147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7a3e9703-c847-4340-a34a-c21fe24841d4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.333378 Jul 27 20:21:37.555714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 415/830] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:37.808315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:37.808885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:37.815359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:37.815799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:37.816590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:37.817028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:37.941745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:37.949992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:37.951498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:37.952666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-de95e894-0559-4c0a-ab81-d55e7907cfa5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148355 Jul 27 20:21:37.953226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 416/831] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:38.577538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f3130deb-8473-46ac-b328-6362d1445ece tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:38.578136 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f3130deb-8473-46ac-b328-6362d1445ece tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:38.584775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3130deb-8473-46ac-b328-6362d1445ece tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:38.585217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3130deb-8473-46ac-b328-6362d1445ece tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:38.585956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3130deb-8473-46ac-b328-6362d1445ece tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:38.586383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3130deb-8473-46ac-b328-6362d1445ece tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:38.716796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f3130deb-8473-46ac-b328-6362d1445ece tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:38.724240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f3130deb-8473-46ac-b328-6362d1445ece tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150524 Jul 27 20:21:38.724833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 416/832] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:21:38.977334 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:38.977951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:38.985908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:38.986330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:38.987164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:38.988224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:39.116258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:39.124391 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:39.125884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:39.127023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5623fb07-1089-4fd9-b9ef-e2f1f7534df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155097 Jul 27 20:21:39.127576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 417/833] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:38 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:39.746101 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5381ef05-c7c4-4393-bd2a-1ea3ac1d0cca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:39.746717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5381ef05-c7c4-4393-bd2a-1ea3ac1d0cca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:39.753723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5381ef05-c7c4-4393-bd2a-1ea3ac1d0cca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:39.754172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5381ef05-c7c4-4393-bd2a-1ea3ac1d0cca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:39.754932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5381ef05-c7c4-4393-bd2a-1ea3ac1d0cca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:39.755370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5381ef05-c7c4-4393-bd2a-1ea3ac1d0cca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:39.884520 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5381ef05-c7c4-4393-bd2a-1ea3ac1d0cca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:39.891959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5381ef05-c7c4-4393-bd2a-1ea3ac1d0cca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149780 Jul 27 20:21:39.892561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 417/834] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:40.150044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:40.150581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:40.157086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:40.157534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:40.158288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:40.158725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:40.286511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:40.294869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:40.296397 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:40.297554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-45f70780-643d-4ea5-b2aa-bccd814e9d32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151460 Jul 27 20:21:40.298110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 418/835] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:40.914365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f834d432-8d40-4608-ac41-68ea6fb19082 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:40.914982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f834d432-8d40-4608-ac41-68ea6fb19082 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:40.921635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f834d432-8d40-4608-ac41-68ea6fb19082 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:40.922089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f834d432-8d40-4608-ac41-68ea6fb19082 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:40.922851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f834d432-8d40-4608-ac41-68ea6fb19082 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:40.923289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f834d432-8d40-4608-ac41-68ea6fb19082 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:41.050981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f834d432-8d40-4608-ac41-68ea6fb19082 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:41.058424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f834d432-8d40-4608-ac41-68ea6fb19082 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147915 Jul 27 20:21:41.059132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 418/836] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:40 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:41.321276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:41.321872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:41.328240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:41.328711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:41.329464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:41.329887 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:41.460719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:41.469261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:41.470777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:41.472186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e29ba940-42e0-40a7-a47b-19d0c202596e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154775 Jul 27 20:21:41.472782 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 419/837] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:41 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:42.079550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-230c58ff-590d-40c8-a56d-59944910e177 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:42.080165 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-230c58ff-590d-40c8-a56d-59944910e177 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:42.086845 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-230c58ff-590d-40c8-a56d-59944910e177 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:42.087297 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-230c58ff-590d-40c8-a56d-59944910e177 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:42.088056 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-230c58ff-590d-40c8-a56d-59944910e177 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:42.088526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-230c58ff-590d-40c8-a56d-59944910e177 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:42.215652 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-230c58ff-590d-40c8-a56d-59944910e177 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:42.223554 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-230c58ff-590d-40c8-a56d-59944910e177 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147923 Jul 27 20:21:42.224123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 419/838] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:42.494528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:42.495125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:42.501736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:42.502175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:42.502914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:42.503338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:42.507219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:42.632244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:42.640601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:42.642146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:42.643795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e71d0583-4125-4db2-855e-fa7cdfc8c531 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152618 Jul 27 20:21:42.644352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 420/839] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:43.245635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-170d06a5-9105-40dc-8f9a-3133f144d1c2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:43.246241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-170d06a5-9105-40dc-8f9a-3133f144d1c2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:43.252663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-170d06a5-9105-40dc-8f9a-3133f144d1c2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:43.253104 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-170d06a5-9105-40dc-8f9a-3133f144d1c2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:43.253848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-170d06a5-9105-40dc-8f9a-3133f144d1c2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:43.254275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-170d06a5-9105-40dc-8f9a-3133f144d1c2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:43.387812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-170d06a5-9105-40dc-8f9a-3133f144d1c2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:43.396048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-170d06a5-9105-40dc-8f9a-3133f144d1c2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.154219 Jul 27 20:21:43.396859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 420/840] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:43 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:43.666646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:43.667158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:43.673661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:43.674108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:43.675585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:43.676018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:43.803291 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:43.811578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:43.813132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:43.814279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d8e86958-ef05-459e-8605-f6ffa53cc063 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151724 Jul 27 20:21:43.814839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 421/841] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:43 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:44.417983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-beed70ef-00e3-401d-9aa7-07e1f7a03cc3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:44.418617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-beed70ef-00e3-401d-9aa7-07e1f7a03cc3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:44.424784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-beed70ef-00e3-401d-9aa7-07e1f7a03cc3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:44.425541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-beed70ef-00e3-401d-9aa7-07e1f7a03cc3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:44.426813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-beed70ef-00e3-401d-9aa7-07e1f7a03cc3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:44.427490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-beed70ef-00e3-401d-9aa7-07e1f7a03cc3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:44.704657 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-beed70ef-00e3-401d-9aa7-07e1f7a03cc3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:44.712010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-beed70ef-00e3-401d-9aa7-07e1f7a03cc3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.297893 Jul 27 20:21:44.712594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 421/842] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:44.837046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:44.837657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:44.844101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:44.844594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:44.845352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:44.845787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:44.973451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:44.981707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:44.983222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:44.984783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a50ca3ec-0ee1-40cb-9f10-09e1b32ffa33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151378 Jul 27 20:21:44.985354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 422/843] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:45.732895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c1f4b949-83ea-4604-9122-2178dfe36b07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:45.733499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c1f4b949-83ea-4604-9122-2178dfe36b07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:45.740195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1f4b949-83ea-4604-9122-2178dfe36b07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:45.740675 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1f4b949-83ea-4604-9122-2178dfe36b07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:45.741629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1f4b949-83ea-4604-9122-2178dfe36b07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:45.742062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1f4b949-83ea-4604-9122-2178dfe36b07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:45.872928 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c1f4b949-83ea-4604-9122-2178dfe36b07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:45.875110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:45.881665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c1f4b949-83ea-4604-9122-2178dfe36b07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152629 Jul 27 20:21:45.882226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 422/844] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:46.008576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:46.009201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:46.015668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:46.016143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:46.016929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:46.017365 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:46.146960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:46.155382 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:46.156921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:46.158106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-748364ab-c3f4-4c93-b84f-3a2cd7ca171b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153456 Jul 27 20:21:46.158652 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 423/845] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:46 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:46.903903 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c81760d5-b506-487a-b527-dbdf84500790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:46.904545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c81760d5-b506-487a-b527-dbdf84500790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:46.911113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c81760d5-b506-487a-b527-dbdf84500790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:46.911559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c81760d5-b506-487a-b527-dbdf84500790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:46.912310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c81760d5-b506-487a-b527-dbdf84500790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:46.912823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c81760d5-b506-487a-b527-dbdf84500790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:47.049614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c81760d5-b506-487a-b527-dbdf84500790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:47.057069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c81760d5-b506-487a-b527-dbdf84500790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.157405 Jul 27 20:21:47.057634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 423/846] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:47.181498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:47.182084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:47.188564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:47.189012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:47.189822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:47.190271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:47.317176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:47.325430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:47.326933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:47.328105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-784ff171-21df-4ab4-bf0a-cf465f5a0a49 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150676 Jul 27 20:21:47.328715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 424/847] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:48.079112 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-832c0f0b-de2d-4d65-ad8d-b1f3faed2d17 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:48.079730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-832c0f0b-de2d-4d65-ad8d-b1f3faed2d17 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:48.087896 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-832c0f0b-de2d-4d65-ad8d-b1f3faed2d17 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:48.088348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-832c0f0b-de2d-4d65-ad8d-b1f3faed2d17 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:48.089140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-832c0f0b-de2d-4d65-ad8d-b1f3faed2d17 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:48.089576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-832c0f0b-de2d-4d65-ad8d-b1f3faed2d17 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:48.215998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-832c0f0b-de2d-4d65-ad8d-b1f3faed2d17 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:48.223473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-832c0f0b-de2d-4d65-ad8d-b1f3faed2d17 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148251 Jul 27 20:21:48.224042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 424/848] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:48 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:48.352454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:48.353066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:48.359757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:48.360211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:48.361001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:48.361432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:48.495575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:48.504465 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:48.505951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:48.507086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2987e525-8cb8-43fb-be3f-74a55aa8d735 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.158622 Jul 27 20:21:48.507645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 425/849] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:48 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:49.244709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8e2cf66c-1739-4478-ae58-ed9c18503845 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:49.245330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8e2cf66c-1739-4478-ae58-ed9c18503845 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:49.251853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e2cf66c-1739-4478-ae58-ed9c18503845 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:49.252302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e2cf66c-1739-4478-ae58-ed9c18503845 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:49.253103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e2cf66c-1739-4478-ae58-ed9c18503845 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:49.253530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e2cf66c-1739-4478-ae58-ed9c18503845 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:49.387622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e2cf66c-1739-4478-ae58-ed9c18503845 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:49.395642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8e2cf66c-1739-4478-ae58-ed9c18503845 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.154832 Jul 27 20:21:49.396204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 425/850] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:49.529914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:49.530478 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:49.537045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:49.537483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:49.538230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:49.538653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:49.676361 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:49.684662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:49.686156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:49.687292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ae8e355-4824-4235-86a3-3e49ff84326a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.161438 Jul 27 20:21:49.687851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 426/851] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:50.417548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0297e605-f573-42b3-a2e1-5b5df3903a42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:50.418577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0297e605-f573-42b3-a2e1-5b5df3903a42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:50.425114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0297e605-f573-42b3-a2e1-5b5df3903a42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:50.425556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0297e605-f573-42b3-a2e1-5b5df3903a42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:50.426307 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0297e605-f573-42b3-a2e1-5b5df3903a42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:50.426736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0297e605-f573-42b3-a2e1-5b5df3903a42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:50.554699 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0297e605-f573-42b3-a2e1-5b5df3903a42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:50.562136 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0297e605-f573-42b3-a2e1-5b5df3903a42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148461 Jul 27 20:21:50.562699 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 426/852] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:50.709574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:50.710200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:50.716709 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:50.717161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:50.717924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:50.718358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:50.843418 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:50.851670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:50.853293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:50.854450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3f11de58-3583-44d2-9a3a-dcac18ef8743 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148943 Jul 27 20:21:50.855012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 427/853] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:50 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:21:51.584453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d232412a-bdc9-4d63-8d4e-dc697bde9c24 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:51.585110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d232412a-bdc9-4d63-8d4e-dc697bde9c24 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:51.591808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d232412a-bdc9-4d63-8d4e-dc697bde9c24 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:51.592201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d232412a-bdc9-4d63-8d4e-dc697bde9c24 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:51.593004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d232412a-bdc9-4d63-8d4e-dc697bde9c24 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:51.593442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d232412a-bdc9-4d63-8d4e-dc697bde9c24 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:51.725579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d232412a-bdc9-4d63-8d4e-dc697bde9c24 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:51.733040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d232412a-bdc9-4d63-8d4e-dc697bde9c24 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153027 Jul 27 20:21:51.733600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 427/854] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:51.877810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:51.878856 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:51.885196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:51.885633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:51.886376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:51.886800 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:52.014012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:52.023021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:52.024549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:52.025738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4645b14a-e732-4fa2-9a82-c5cd080c3496 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151823 Jul 27 20:21:52.026307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 428/855] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:52.754767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-99bf2c6c-8a85-41cf-82cc-d911b5bccf5d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:52.755374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-99bf2c6c-8a85-41cf-82cc-d911b5bccf5d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:52.761846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99bf2c6c-8a85-41cf-82cc-d911b5bccf5d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:52.762385 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99bf2c6c-8a85-41cf-82cc-d911b5bccf5d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:52.763141 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99bf2c6c-8a85-41cf-82cc-d911b5bccf5d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:52.763573 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99bf2c6c-8a85-41cf-82cc-d911b5bccf5d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:52.893541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-99bf2c6c-8a85-41cf-82cc-d911b5bccf5d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:52.901915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-99bf2c6c-8a85-41cf-82cc-d911b5bccf5d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151604 Jul 27 20:21:52.902486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 428/856] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:53.048695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:53.049258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:53.056246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:53.056725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:53.057483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:53.057918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:53.186098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:53.194516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:53.196046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:53.197229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6bbcde95-24df-4303-949f-99a8aabb0676 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152584 Jul 27 20:21:53.197786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 429/857] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:53 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:53.515234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:21:53.515389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:21:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:21:53.922893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e006def5-745c-4945-93d9-dff32c91d4e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:53.923512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e006def5-745c-4945-93d9-dff32c91d4e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:53.930009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e006def5-745c-4945-93d9-dff32c91d4e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:53.930462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e006def5-745c-4945-93d9-dff32c91d4e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:53.931225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e006def5-745c-4945-93d9-dff32c91d4e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:53.931664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e006def5-745c-4945-93d9-dff32c91d4e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:54.063318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e006def5-745c-4945-93d9-dff32c91d4e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:54.071579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e006def5-745c-4945-93d9-dff32c91d4e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152546 Jul 27 20:21:54.072153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 429/858] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:54.219789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:54.220357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:54.227301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:54.227749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:54.228542 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:54.228978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:54.355289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:54.363864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:54.365424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:54.366568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a6c4b0f5-ddbe-4782-b76b-f0eb63c83c8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150738 Jul 27 20:21:54.367117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 430/859] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:54 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:55.093433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3eb408d3-7a5a-4f9d-a4fc-a88413523892 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:55.094039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3eb408d3-7a5a-4f9d-a4fc-a88413523892 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:55.096286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=52 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:55.101075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3eb408d3-7a5a-4f9d-a4fc-a88413523892 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:55.111905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3eb408d3-7a5a-4f9d-a4fc-a88413523892 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:55.111905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3eb408d3-7a5a-4f9d-a4fc-a88413523892 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:55.111905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3eb408d3-7a5a-4f9d-a4fc-a88413523892 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:55.233406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3eb408d3-7a5a-4f9d-a4fc-a88413523892 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:55.241115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3eb408d3-7a5a-4f9d-a4fc-a88413523892 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151507 Jul 27 20:21:55.241687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 430/860] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:55.388874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:55.389486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:55.396189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:55.396666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:55.397432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:55.397867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:55.526444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:55.534716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:55.536232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:55.537424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-187c5287-d8c5-466a-b429-a6c4a244728a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152438 Jul 27 20:21:55.537983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 431/861] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:55 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:56.262112 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9573ee0e-36ab-48d2-b796-874168e8b823 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:56.262720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9573ee0e-36ab-48d2-b796-874168e8b823 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:56.269087 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9573ee0e-36ab-48d2-b796-874168e8b823 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:56.269529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9573ee0e-36ab-48d2-b796-874168e8b823 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:56.270283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9573ee0e-36ab-48d2-b796-874168e8b823 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:56.270710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9573ee0e-36ab-48d2-b796-874168e8b823 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:56.398563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9573ee0e-36ab-48d2-b796-874168e8b823 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:56.406042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9573ee0e-36ab-48d2-b796-874168e8b823 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147747 Jul 27 20:21:56.406612 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 431/862] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:56.560017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:56.560612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:56.562884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=52 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:56.567947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:56.568416 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:56.569192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:56.569626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:56.697971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:56.706653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:56.708145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:56.709312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-64adc3ef-877f-4726-befd-4735333baec3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153300 Jul 27 20:21:56.709866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 432/863] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:21:57.428424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3a13a135-2ba3-4d8c-8c46-a61c67ff1786 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:57.429040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3a13a135-2ba3-4d8c-8c46-a61c67ff1786 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:57.435501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a13a135-2ba3-4d8c-8c46-a61c67ff1786 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:57.435947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a13a135-2ba3-4d8c-8c46-a61c67ff1786 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:57.436769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a13a135-2ba3-4d8c-8c46-a61c67ff1786 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:57.437200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a13a135-2ba3-4d8c-8c46-a61c67ff1786 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:57.564361 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3a13a135-2ba3-4d8c-8c46-a61c67ff1786 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:57.572507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3a13a135-2ba3-4d8c-8c46-a61c67ff1786 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148499 Jul 27 20:21:57.573078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 432/864] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:57.732942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:57.733555 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:57.741155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:57.741605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:57.742414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:57.742845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:57.866296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:57.874546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:57.876052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:57.877233 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-86a10940-6f9b-4794-bbed-c507afd9da0c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148251 Jul 27 20:21:57.877793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 433/865] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:58.593617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d2f203d2-b146-47fb-8a62-3679ab82bb6b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:58.594192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d2f203d2-b146-47fb-8a62-3679ab82bb6b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:58.601545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2f203d2-b146-47fb-8a62-3679ab82bb6b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:58.601993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2f203d2-b146-47fb-8a62-3679ab82bb6b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:58.602752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2f203d2-b146-47fb-8a62-3679ab82bb6b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:58.603188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2f203d2-b146-47fb-8a62-3679ab82bb6b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:58.736502 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d2f203d2-b146-47fb-8a62-3679ab82bb6b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:58.744689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d2f203d2-b146-47fb-8a62-3679ab82bb6b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.154993 Jul 27 20:21:58.745262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 433/866] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:58.900162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:58.900750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:58.907123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:58.907567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:58.908310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:58.908760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:59.034788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:59.043040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:59.044610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:59.045750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2f3ec622-4e4c-438d-a6eb-8a4931d27dd7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149541 Jul 27 20:21:59.046307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 434/867] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:21:58 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:21:59.765301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a3bf64f5-4da3-4441-9a21-9c00db002707 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:59.765911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a3bf64f5-4da3-4441-9a21-9c00db002707 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:59.772268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a3bf64f5-4da3-4441-9a21-9c00db002707 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:59.772745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a3bf64f5-4da3-4441-9a21-9c00db002707 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:59.773494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a3bf64f5-4da3-4441-9a21-9c00db002707 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:59.773927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a3bf64f5-4da3-4441-9a21-9c00db002707 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:59.904009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a3bf64f5-4da3-4441-9a21-9c00db002707 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:59.911951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a3bf64f5-4da3-4441-9a21-9c00db002707 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150459 Jul 27 20:21:59.912535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 434/868] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:59 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:00.073873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:00.074406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:00.080903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:00.081364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:00.082130 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:00.082557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:00.209832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:00.218272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:00.219768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:00.220958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4b12374e-0363-4222-88a0-0394bbc767bd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151074 Jul 27 20:22:00.222040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 435/869] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:00 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:00.933701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1826a238-0521-4259-a37f-40e554ae3656 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:00.934312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1826a238-0521-4259-a37f-40e554ae3656 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:00.941302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1826a238-0521-4259-a37f-40e554ae3656 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:00.941782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1826a238-0521-4259-a37f-40e554ae3656 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:00.942541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1826a238-0521-4259-a37f-40e554ae3656 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:00.942988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1826a238-0521-4259-a37f-40e554ae3656 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:01.083111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1826a238-0521-4259-a37f-40e554ae3656 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:01.090684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1826a238-0521-4259-a37f-40e554ae3656 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.160809 Jul 27 20:22:01.091267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 435/870] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:01.244332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:01.244961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:01.251327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:01.251766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:01.252541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:01.253566 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:01.381639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:01.385085 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:01.390259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:01.391761 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:01.392947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5ff7715a-0c5d-4ecb-836d-af6c85011a64 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152492 Jul 27 20:22:01.394197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 436/871] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:02.112476 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-585584da-a941-491a-8f90-729eab286c11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:02.113109 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-585584da-a941-491a-8f90-729eab286c11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:02.119702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-585584da-a941-491a-8f90-729eab286c11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:02.120177 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-585584da-a941-491a-8f90-729eab286c11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:02.121047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-585584da-a941-491a-8f90-729eab286c11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:02.121482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-585584da-a941-491a-8f90-729eab286c11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:02.249542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-585584da-a941-491a-8f90-729eab286c11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:02.257011 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-585584da-a941-491a-8f90-729eab286c11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149220 Jul 27 20:22:02.257581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 436/872] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:02 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:02.416274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:02.416907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:02.423504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:02.423949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:02.425455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:02.425906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:02.554380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:02.562603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:02.564124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:02.565329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-13a8a741-967b-4f0e-a5b5-f4b089ded951 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153307 Jul 27 20:22:02.565962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 437/873] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:02 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:03.278207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6cb824a4-9caa-40be-91ba-79bdc4956e8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:03.278816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6cb824a4-9caa-40be-91ba-79bdc4956e8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:03.285376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6cb824a4-9caa-40be-91ba-79bdc4956e8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:03.285828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6cb824a4-9caa-40be-91ba-79bdc4956e8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:03.286588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6cb824a4-9caa-40be-91ba-79bdc4956e8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:03.287026 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6cb824a4-9caa-40be-91ba-79bdc4956e8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:03.416184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6cb824a4-9caa-40be-91ba-79bdc4956e8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:03.423564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6cb824a4-9caa-40be-91ba-79bdc4956e8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149296 Jul 27 20:22:03.424129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 437/874] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:03.589772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:03.590365 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:03.597455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:03.597906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:03.598679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:03.599099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:03.725649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:03.734185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:03.735736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:03.736957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ebffb397-a428-4200-b34e-2744b0b5ace2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151168 Jul 27 20:22:03.737507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 438/875] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:04.444835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c17b8409-328d-4277-854e-9245062a410b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:04.445471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c17b8409-328d-4277-854e-9245062a410b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:04.451983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c17b8409-328d-4277-854e-9245062a410b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:04.452459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c17b8409-328d-4277-854e-9245062a410b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:04.453214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c17b8409-328d-4277-854e-9245062a410b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:04.453643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c17b8409-328d-4277-854e-9245062a410b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:04.494240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:22:04.494467 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:22:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa (ip 10.222.0.47) !!! Jul 27 20:22:04.581060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c17b8409-328d-4277-854e-9245062a410b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:04.588474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c17b8409-328d-4277-854e-9245062a410b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147534 Jul 27 20:22:04.589040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 438/876] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:04.759219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:04.759821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:04.766338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:04.766775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:04.767518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:04.767945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:04.892147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:04.900899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:04.902394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:04.903532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0ae9398f-37c0-4a96-80d6-50049698e4f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148206 Jul 27 20:22:04.904094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 439/877] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:04 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:05.610529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2e3d5529-c0f3-452d-bbe3-31f7c02cc18e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:05.611070 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2e3d5529-c0f3-452d-bbe3-31f7c02cc18e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:05.619870 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e3d5529-c0f3-452d-bbe3-31f7c02cc18e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:05.620309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e3d5529-c0f3-452d-bbe3-31f7c02cc18e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:05.621090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e3d5529-c0f3-452d-bbe3-31f7c02cc18e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:05.621516 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e3d5529-c0f3-452d-bbe3-31f7c02cc18e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:05.636309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:05.754307 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2e3d5529-c0f3-452d-bbe3-31f7c02cc18e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:05.761763 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2e3d5529-c0f3-452d-bbe3-31f7c02cc18e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.155502 Jul 27 20:22:05.763843 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 439/878] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:05.926425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:05.926949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:05.933288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:05.933728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:05.934515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:05.934885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:06.059490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:06.068230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:06.069745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:06.070907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0303ca61-53ba-4a6a-87fa-8801a4a0c1ce tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149051 Jul 27 20:22:06.071462 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 440/879] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:05 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:06.783367 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-637eff3b-6ea8-40c7-8481-2abd53877bdf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:06.784023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-637eff3b-6ea8-40c7-8481-2abd53877bdf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:06.790682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637eff3b-6ea8-40c7-8481-2abd53877bdf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:06.791132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637eff3b-6ea8-40c7-8481-2abd53877bdf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:06.791901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637eff3b-6ea8-40c7-8481-2abd53877bdf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:06.792368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637eff3b-6ea8-40c7-8481-2abd53877bdf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:06.922961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-637eff3b-6ea8-40c7-8481-2abd53877bdf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:06.930474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-637eff3b-6ea8-40c7-8481-2abd53877bdf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150939 Jul 27 20:22:06.931035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 440/880] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:07.094763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:07.095335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:07.101764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:07.102224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:07.102983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:07.103420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:07.229388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:07.238408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:07.239932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:07.241123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5886ae04-c42a-40ee-bc79-a9ee7ffef48b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150398 Jul 27 20:22:07.241684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 441/881] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:07 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:07.952314 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d91b6fb0-7f28-419e-8962-8c8d96190130 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:07.952953 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d91b6fb0-7f28-419e-8962-8c8d96190130 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:07.959868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d91b6fb0-7f28-419e-8962-8c8d96190130 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:07.960324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d91b6fb0-7f28-419e-8962-8c8d96190130 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:07.961120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d91b6fb0-7f28-419e-8962-8c8d96190130 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:07.961559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d91b6fb0-7f28-419e-8962-8c8d96190130 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:08.091084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d91b6fb0-7f28-419e-8962-8c8d96190130 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:08.099059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d91b6fb0-7f28-419e-8962-8c8d96190130 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150630 Jul 27 20:22:08.099625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 441/882] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:22:08.264363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:08.265019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:08.272046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:08.272516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:08.273265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:08.273687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:08.398533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:08.406744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:08.408265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:08.409429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-91c1e9b3-1168-4542-b208-f6e369dc3031 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148964 Jul 27 20:22:08.409983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 442/883] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:08 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:09.120364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-607a5ec9-8f3a-4f10-b993-1ca2293373de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:09.121018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-607a5ec9-8f3a-4f10-b993-1ca2293373de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:09.127880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-607a5ec9-8f3a-4f10-b993-1ca2293373de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:09.128320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-607a5ec9-8f3a-4f10-b993-1ca2293373de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:09.129089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-607a5ec9-8f3a-4f10-b993-1ca2293373de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:09.129517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-607a5ec9-8f3a-4f10-b993-1ca2293373de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:09.261487 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-607a5ec9-8f3a-4f10-b993-1ca2293373de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:09.269508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-607a5ec9-8f3a-4f10-b993-1ca2293373de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152958 Jul 27 20:22:09.270065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 442/884] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:09 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:09.431365 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:09.431947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:09.438575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:09.439018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:09.440438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:09.440872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:09.572103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:09.580331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:09.581842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:09.582981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5084c70a-4882-4c1a-934a-a624d62e584f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155619 Jul 27 20:22:09.583565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 443/885] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:10.291048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-739d60c9-36cb-4f23-8410-a1fd27994c04 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:10.291666 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-739d60c9-36cb-4f23-8410-a1fd27994c04 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:10.298142 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-739d60c9-36cb-4f23-8410-a1fd27994c04 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:10.298594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-739d60c9-36cb-4f23-8410-a1fd27994c04 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:10.299347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-739d60c9-36cb-4f23-8410-a1fd27994c04 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:10.299784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-739d60c9-36cb-4f23-8410-a1fd27994c04 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:10.427073 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-739d60c9-36cb-4f23-8410-a1fd27994c04 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:10.434723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-739d60c9-36cb-4f23-8410-a1fd27994c04 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147578 Jul 27 20:22:10.435288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 443/886] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:10.605725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:10.606266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:10.612987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:10.613434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:10.614185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:10.614614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:10.743721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:10.752684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:10.754191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:10.755345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4bb728ee-12ad-4fff-a97f-f1c19161e841 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153556 Jul 27 20:22:10.755909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 444/887] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:11.455779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1b29ef4b-bb9b-401a-9c8a-dd8e1e087197 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:11.456311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1b29ef4b-bb9b-401a-9c8a-dd8e1e087197 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:11.462825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b29ef4b-bb9b-401a-9c8a-dd8e1e087197 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:11.463268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b29ef4b-bb9b-401a-9c8a-dd8e1e087197 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:11.464012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b29ef4b-bb9b-401a-9c8a-dd8e1e087197 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:11.464563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b29ef4b-bb9b-401a-9c8a-dd8e1e087197 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:11.590477 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1b29ef4b-bb9b-401a-9c8a-dd8e1e087197 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:11.598479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1b29ef4b-bb9b-401a-9c8a-dd8e1e087197 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.146565 Jul 27 20:22:11.599048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 444/888] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:11.778805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:11.779421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:11.786606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:11.787057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:11.787820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:11.788257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:11.915924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:11.924232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:11.925971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:11.927222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e2ca276d-a861-42a8-8e11-c39caddfaae6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152399 Jul 27 20:22:11.927808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 445/889] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:11 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:12.619740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a65e9ee8-0a05-42a0-9d5d-c51c851e4199 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:12.620296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a65e9ee8-0a05-42a0-9d5d-c51c851e4199 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:12.626782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a65e9ee8-0a05-42a0-9d5d-c51c851e4199 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:12.627864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a65e9ee8-0a05-42a0-9d5d-c51c851e4199 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:12.628634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a65e9ee8-0a05-42a0-9d5d-c51c851e4199 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:12.629061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a65e9ee8-0a05-42a0-9d5d-c51c851e4199 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:12.760153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a65e9ee8-0a05-42a0-9d5d-c51c851e4199 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:12.767623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a65e9ee8-0a05-42a0-9d5d-c51c851e4199 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151850 Jul 27 20:22:12.768185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 445/890] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:12.950781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:12.951312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:12.957837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:12.958288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:12.959036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:12.959467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:13.086575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:13.094776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:13.096276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:13.097440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a3a4d9b1-9318-4b1f-9e9e-aee070865c32 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150770 Jul 27 20:22:13.097990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 446/891] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:12 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:13.789252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6388d897-6236-48eb-a571-53d38504f7ae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:13.789867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6388d897-6236-48eb-a571-53d38504f7ae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:13.796156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6388d897-6236-48eb-a571-53d38504f7ae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:13.796645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6388d897-6236-48eb-a571-53d38504f7ae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:13.797408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6388d897-6236-48eb-a571-53d38504f7ae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:13.797842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6388d897-6236-48eb-a571-53d38504f7ae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:13.934846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6388d897-6236-48eb-a571-53d38504f7ae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:13.943479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6388d897-6236-48eb-a571-53d38504f7ae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.157600 Jul 27 20:22:13.943581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 446/892] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:14.121128 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:14.121654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:14.128837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:14.129289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:14.130046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:14.130481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:14.257650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:14.265995 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:14.267512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:14.268686 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8ea84e00-889d-4ead-9ffd-72738d4dc136 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151522 Jul 27 20:22:14.269255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 447/893] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:14 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:14.963912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6c3f69d4-dea4-4aa1-ac46-3bcc2bd8cde3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:14.964547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6c3f69d4-dea4-4aa1-ac46-3bcc2bd8cde3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:14.971096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c3f69d4-dea4-4aa1-ac46-3bcc2bd8cde3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:14.971543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c3f69d4-dea4-4aa1-ac46-3bcc2bd8cde3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:14.972290 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c3f69d4-dea4-4aa1-ac46-3bcc2bd8cde3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:14.972745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c3f69d4-dea4-4aa1-ac46-3bcc2bd8cde3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:15.109174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6c3f69d4-dea4-4aa1-ac46-3bcc2bd8cde3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:15.110662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6c3f69d4-dea4-4aa1-ac46-3bcc2bd8cde3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150590 Jul 27 20:22:15.111216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 447/894] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:15.291771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:15.292404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:15.299438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:15.299886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:15.300673 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:15.301120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:15.426090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:15.434392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:15.435907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:15.437100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-80c5b328-ea66-4388-9765-dfa7c79b154b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149300 Jul 27 20:22:15.437666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 448/895] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:16.131155 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2696b49c-a021-4c75-9d48-b1f3eceb8dea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:16.131760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2696b49c-a021-4c75-9d48-b1f3eceb8dea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:16.138289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2696b49c-a021-4c75-9d48-b1f3eceb8dea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:16.138733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2696b49c-a021-4c75-9d48-b1f3eceb8dea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:16.139482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2696b49c-a021-4c75-9d48-b1f3eceb8dea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:16.139910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2696b49c-a021-4c75-9d48-b1f3eceb8dea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:16.268114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2696b49c-a021-4c75-9d48-b1f3eceb8dea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:16.275578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2696b49c-a021-4c75-9d48-b1f3eceb8dea tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148308 Jul 27 20:22:16.276152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 448/896] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:16.461182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:16.461762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:16.468270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:16.468926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:16.469700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:16.470134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:16.597348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:16.605594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:16.607106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:16.608263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cd930bcc-ef82-4c76-ba8c-17e9e8ad3a6e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151225 Jul 27 20:22:16.609124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 449/897] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:16 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:17.297154 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b8bde9a0-dd50-4a07-b423-96852a755ea0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:17.297759 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b8bde9a0-dd50-4a07-b423-96852a755ea0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:17.304725 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8bde9a0-dd50-4a07-b423-96852a755ea0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:17.305173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8bde9a0-dd50-4a07-b423-96852a755ea0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:17.305920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8bde9a0-dd50-4a07-b423-96852a755ea0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:17.306350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8bde9a0-dd50-4a07-b423-96852a755ea0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:17.443363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b8bde9a0-dd50-4a07-b423-96852a755ea0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:17.450344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b8bde9a0-dd50-4a07-b423-96852a755ea0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.156944 Jul 27 20:22:17.450947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 449/898] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:17.630302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:17.630842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:17.637272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:17.637722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:17.638485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:17.638922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:17.770332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:17.778557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:17.780057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:17.781227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-804c9f32-3559-4613-bab1-d7946057cf96 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154925 Jul 27 20:22:17.781789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 450/899] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:18.472314 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-efb83a91-4e1b-42c7-abfb-05df75aaa4a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:18.472982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-efb83a91-4e1b-42c7-abfb-05df75aaa4a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:18.479403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-efb83a91-4e1b-42c7-abfb-05df75aaa4a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:18.479852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-efb83a91-4e1b-42c7-abfb-05df75aaa4a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:18.480642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-efb83a91-4e1b-42c7-abfb-05df75aaa4a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:18.481078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-efb83a91-4e1b-42c7-abfb-05df75aaa4a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:18.608358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-efb83a91-4e1b-42c7-abfb-05df75aaa4a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:18.616562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-efb83a91-4e1b-42c7-abfb-05df75aaa4a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148491 Jul 27 20:22:18.617128 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 450/900] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:18.805237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:18.805882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:18.812506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:18.812958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:18.813720 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:18.814587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:18.940628 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:18.949058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:18.950603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:18.951804 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b4149ccb-30f3-42e3-b807-be39d5d7cfa9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150486 Jul 27 20:22:18.952357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 451/901] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:18 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:19.638642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c594afa8-73ae-4d94-99a5-de0b03713597 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:19.639222 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c594afa8-73ae-4d94-99a5-de0b03713597 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:19.646270 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c594afa8-73ae-4d94-99a5-de0b03713597 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:19.646731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c594afa8-73ae-4d94-99a5-de0b03713597 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:19.647522 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c594afa8-73ae-4d94-99a5-de0b03713597 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:19.647960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c594afa8-73ae-4d94-99a5-de0b03713597 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:19.775848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c594afa8-73ae-4d94-99a5-de0b03713597 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:19.783430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c594afa8-73ae-4d94-99a5-de0b03713597 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148921 Jul 27 20:22:19.783997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 451/902] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:19.975221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:19.975834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:19.982294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:19.982747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:19.983749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:19.984178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:20.112467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:20.120689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:20.122207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:20.123344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4209b6b1-5e93-458b-b1a0-c96a1269ecf6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152078 Jul 27 20:22:20.123902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 452/903] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:19 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:20.806637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-70239c18-b135-43bd-87ed-fbcd55345f8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:20.807260 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-70239c18-b135-43bd-87ed-fbcd55345f8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:20.813737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70239c18-b135-43bd-87ed-fbcd55345f8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:20.814751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70239c18-b135-43bd-87ed-fbcd55345f8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:20.815514 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70239c18-b135-43bd-87ed-fbcd55345f8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:20.815951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70239c18-b135-43bd-87ed-fbcd55345f8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:20.947244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-70239c18-b135-43bd-87ed-fbcd55345f8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:20.954659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-70239c18-b135-43bd-87ed-fbcd55345f8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153644 Jul 27 20:22:20.955222 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 452/904] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:21.147100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:21.147623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:21.154032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:21.154476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:21.155225 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:21.155652 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:21.175483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:21.283168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:21.291361 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:21.292891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:21.294035 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b889f34b-2d9d-496a-8db6-c3a8bdfb83cd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150919 Jul 27 20:22:21.294595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 453/905] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:21.976063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d20dd8a5-b785-4d16-99ff-b9c592414192 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:21.976704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d20dd8a5-b785-4d16-99ff-b9c592414192 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:21.983170 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d20dd8a5-b785-4d16-99ff-b9c592414192 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:21.983884 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d20dd8a5-b785-4d16-99ff-b9c592414192 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:21.984664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d20dd8a5-b785-4d16-99ff-b9c592414192 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:21.985100 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d20dd8a5-b785-4d16-99ff-b9c592414192 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:22.116153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d20dd8a5-b785-4d16-99ff-b9c592414192 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:22.123897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d20dd8a5-b785-4d16-99ff-b9c592414192 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151722 Jul 27 20:22:22.124484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 453/906] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:22:22.316147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:22.316777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:22.323131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:22.323572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:22.324311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:22.324757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:22.450040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:22.458915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:22.460452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:22.461606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7285b22e-38ef-46b9-897b-7a3e00123f63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149295 Jul 27 20:22:22.462174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 454/907] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:23.144458 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cfefc80f-8114-4059-b3b0-0644e9fd7c49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:23.145061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cfefc80f-8114-4059-b3b0-0644e9fd7c49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:23.151595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfefc80f-8114-4059-b3b0-0644e9fd7c49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:23.152033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfefc80f-8114-4059-b3b0-0644e9fd7c49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:23.152802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfefc80f-8114-4059-b3b0-0644e9fd7c49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:23.153241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfefc80f-8114-4059-b3b0-0644e9fd7c49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:23.279997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cfefc80f-8114-4059-b3b0-0644e9fd7c49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:23.288716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cfefc80f-8114-4059-b3b0-0644e9fd7c49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148119 Jul 27 20:22:23.289307 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 454/908] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:23.485038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:23.486231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:23.492702 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:23.493155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:23.493939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:23.494379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:23.623116 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:23.631468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:23.633041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:23.634197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e455b8e4-fa64-410e-921d-1bd4ea5695e6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153660 Jul 27 20:22:23.634755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 455/909] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:23 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:24.313008 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d553574f-868d-4572-bf63-7da087960976 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:24.314157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d553574f-868d-4572-bf63-7da087960976 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:24.320628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d553574f-868d-4572-bf63-7da087960976 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:24.321082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d553574f-868d-4572-bf63-7da087960976 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:24.321839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d553574f-868d-4572-bf63-7da087960976 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:24.322278 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d553574f-868d-4572-bf63-7da087960976 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:24.452441 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d553574f-868d-4572-bf63-7da087960976 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:24.460412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d553574f-868d-4572-bf63-7da087960976 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151337 Jul 27 20:22:24.460991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 455/910] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:24.657454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:24.657995 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:24.664510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:24.664963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:24.665748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:24.666195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:24.793420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:24.801673 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:24.803189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:24.804340 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c06efce0-a5ce-4799-884f-efcb0497fce8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150856 Jul 27 20:22:24.804931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 456/911] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:24 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:25.482562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4aa69252-5808-48f0-b5e5-64b17875e7d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:25.483176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4aa69252-5808-48f0-b5e5-64b17875e7d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:25.486466 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=52 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:25.491212 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4aa69252-5808-48f0-b5e5-64b17875e7d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:25.491664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4aa69252-5808-48f0-b5e5-64b17875e7d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:25.492479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4aa69252-5808-48f0-b5e5-64b17875e7d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:25.497289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4aa69252-5808-48f0-b5e5-64b17875e7d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:25.497289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:25.621693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4aa69252-5808-48f0-b5e5-64b17875e7d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:25.629182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4aa69252-5808-48f0-b5e5-64b17875e7d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150520 Jul 27 20:22:25.629753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 456/912] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:25.827053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:25.827656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:25.834100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:25.834539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:25.835281 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:25.835706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:25.962472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:25.971398 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:25.972953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:25.974114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4adf2481-2ec5-483c-bd20-c6e62a46768f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151039 Jul 27 20:22:25.974674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 457/913] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:25 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:26.650481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6c8a6079-edff-4041-9961-7cf79d3bb101 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:26.651090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6c8a6079-edff-4041-9961-7cf79d3bb101 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:26.657906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c8a6079-edff-4041-9961-7cf79d3bb101 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:26.658350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c8a6079-edff-4041-9961-7cf79d3bb101 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:26.659103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c8a6079-edff-4041-9961-7cf79d3bb101 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:26.659534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c8a6079-edff-4041-9961-7cf79d3bb101 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:26.997074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:26.997686 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:26.999961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=52 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:27.005421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:27.018665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:27.018665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:27.018665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:27.132063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6c8a6079-edff-4041-9961-7cf79d3bb101 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:27.139562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6c8a6079-edff-4041-9961-7cf79d3bb101 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.492984 Jul 27 20:22:27.140137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 457/914] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:27.220726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:27.229159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:27.230660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:27.231809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-69a4ade2-6445-40a7-807b-53127dc48e24 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.238707 Jul 27 20:22:27.232369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 458/915] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:26 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:28.162031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7dff0fcb-3511-414f-af44-8fa305aa343e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:28.162648 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7dff0fcb-3511-414f-af44-8fa305aa343e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:28.169058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7dff0fcb-3511-414f-af44-8fa305aa343e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:28.169494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7dff0fcb-3511-414f-af44-8fa305aa343e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:28.170243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7dff0fcb-3511-414f-af44-8fa305aa343e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:28.170667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7dff0fcb-3511-414f-af44-8fa305aa343e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:28.254887 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:28.255502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:28.262289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:28.262742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:28.263504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:28.263937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:28.301820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7dff0fcb-3511-414f-af44-8fa305aa343e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:28.309661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7dff0fcb-3511-414f-af44-8fa305aa343e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151378 Jul 27 20:22:28.310238 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 458/916] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:28.401455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:28.410205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:28.411703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:28.412906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3b1c1b64-678f-45b9-9d9b-bcc03476523e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.161901 Jul 27 20:22:28.413478 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 459/917] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:28 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:29.331365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-192c00e1-e895-451e-a67d-dfdb6b6a5185 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:29.332007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-192c00e1-e895-451e-a67d-dfdb6b6a5185 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:29.338738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-192c00e1-e895-451e-a67d-dfdb6b6a5185 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:29.339179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-192c00e1-e895-451e-a67d-dfdb6b6a5185 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:29.339947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-192c00e1-e895-451e-a67d-dfdb6b6a5185 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:29.340400 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-192c00e1-e895-451e-a67d-dfdb6b6a5185 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:29.434890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:29.435502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:29.442277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:29.442732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:29.443570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:29.444013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:29.473057 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-192c00e1-e895-451e-a67d-dfdb6b6a5185 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:29.480771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-192c00e1-e895-451e-a67d-dfdb6b6a5185 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153944 Jul 27 20:22:29.481352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 459/918] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:29.575753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:29.584218 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:29.585713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:29.586870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3df3dffd-8010-48db-9a3c-5f94a1965323 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155816 Jul 27 20:22:29.587431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 460/919] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:29 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:30.503038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2c4774e9-2c94-4fee-bfac-010c42cda491 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:30.503641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2c4774e9-2c94-4fee-bfac-010c42cda491 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:30.510186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c4774e9-2c94-4fee-bfac-010c42cda491 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:30.510630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c4774e9-2c94-4fee-bfac-010c42cda491 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:30.511374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c4774e9-2c94-4fee-bfac-010c42cda491 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:30.511799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c4774e9-2c94-4fee-bfac-010c42cda491 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:30.611100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:30.611617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:30.618204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:30.618653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:30.619420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:30.619855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:30.642046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2c4774e9-2c94-4fee-bfac-010c42cda491 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:30.649582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2c4774e9-2c94-4fee-bfac-010c42cda491 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151010 Jul 27 20:22:30.650142 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 460/920] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:30.746641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:30.754944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:30.756487 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:30.757643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-12ebda73-5c48-4c20-9423-b9736e2c0b92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151299 Jul 27 20:22:30.758209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 461/921] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:31.670870 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5a1cd35d-0942-4e89-b89f-dc9d37e3623c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:31.671456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5a1cd35d-0942-4e89-b89f-dc9d37e3623c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:31.678594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a1cd35d-0942-4e89-b89f-dc9d37e3623c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:31.679043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a1cd35d-0942-4e89-b89f-dc9d37e3623c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:31.679794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a1cd35d-0942-4e89-b89f-dc9d37e3623c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:31.680225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a1cd35d-0942-4e89-b89f-dc9d37e3623c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:31.780066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:31.780905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:31.788066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:31.788565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:31.789337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:31.789772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:31.811582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5a1cd35d-0942-4e89-b89f-dc9d37e3623c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:31.820886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5a1cd35d-0942-4e89-b89f-dc9d37e3623c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153848 Jul 27 20:22:31.821557 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 461/922] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:31.922087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:31.930518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:31.932015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:31.933203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-235a0ae2-b3a5-4dc1-a458-52c43b48ccc4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.157034 Jul 27 20:22:31.933789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 462/923] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:31 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:32.842580 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b3130ceb-6ced-421c-a0f8-be0cc396abb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:32.843184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b3130ceb-6ced-421c-a0f8-be0cc396abb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:32.849834 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3130ceb-6ced-421c-a0f8-be0cc396abb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:32.850285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3130ceb-6ced-421c-a0f8-be0cc396abb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:32.851044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3130ceb-6ced-421c-a0f8-be0cc396abb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:32.851483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3130ceb-6ced-421c-a0f8-be0cc396abb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:32.957399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:32.958692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:32.965948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:32.966393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:32.967168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:32.967603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:32.989864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b3130ceb-6ced-421c-a0f8-be0cc396abb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:32.997500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b3130ceb-6ced-421c-a0f8-be0cc396abb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.158834 Jul 27 20:22:32.998342 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 462/924] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:33.099945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:33.112005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:33.113627 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:33.114916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f2415f6e-1f01-4323-9de1-8874c8c479af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.162184 Jul 27 20:22:33.115808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 463/925] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:32 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:34.019328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ac9e4c0e-f89f-46d3-b7e9-c2f28b3ea32f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:34.019935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ac9e4c0e-f89f-46d3-b7e9-c2f28b3ea32f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:34.026528 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac9e4c0e-f89f-46d3-b7e9-c2f28b3ea32f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:34.026969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac9e4c0e-f89f-46d3-b7e9-c2f28b3ea32f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:34.027774 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac9e4c0e-f89f-46d3-b7e9-c2f28b3ea32f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:34.028200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac9e4c0e-f89f-46d3-b7e9-c2f28b3ea32f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:34.138854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:34.139472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:34.145910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:34.146362 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:34.147170 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:34.147611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:34.159889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ac9e4c0e-f89f-46d3-b7e9-c2f28b3ea32f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:34.167471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ac9e4c0e-f89f-46d3-b7e9-c2f28b3ea32f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152875 Jul 27 20:22:34.168081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 463/926] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:34.278238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:34.286524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:34.288039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:34.289200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4c3e4f8c-d714-4683-b53b-b973789051cf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154355 Jul 27 20:22:34.289767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 464/927] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:35.190104 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fa0c90df-d639-4a6d-be1a-8f39502ca375 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:35.190704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fa0c90df-d639-4a6d-be1a-8f39502ca375 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:35.197376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa0c90df-d639-4a6d-be1a-8f39502ca375 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:35.197822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa0c90df-d639-4a6d-be1a-8f39502ca375 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:35.198635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa0c90df-d639-4a6d-be1a-8f39502ca375 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:35.199063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa0c90df-d639-4a6d-be1a-8f39502ca375 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:35.312780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:35.313885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:35.320568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:35.321020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:35.321785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:35.322224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:35.326074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fa0c90df-d639-4a6d-be1a-8f39502ca375 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:35.334275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fa0c90df-d639-4a6d-be1a-8f39502ca375 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148551 Jul 27 20:22:35.345284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 464/928] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:35 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:35.455714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:35.463941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:35.465594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:35.466766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-15bd35fc-c301-48c2-92fa-a1512ad1548a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.158010 Jul 27 20:22:35.467321 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 465/929] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:35 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:36.355180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dc4d2f10-7573-43a3-92ba-252219464782 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:36.355832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dc4d2f10-7573-43a3-92ba-252219464782 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:36.362627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc4d2f10-7573-43a3-92ba-252219464782 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:36.363083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc4d2f10-7573-43a3-92ba-252219464782 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:36.363847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc4d2f10-7573-43a3-92ba-252219464782 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:36.364284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc4d2f10-7573-43a3-92ba-252219464782 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:36.489766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:36.490457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:36.493077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dc4d2f10-7573-43a3-92ba-252219464782 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:36.496803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:36.497249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:36.498005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:36.498442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:36.501452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dc4d2f10-7573-43a3-92ba-252219464782 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150226 Jul 27 20:22:36.502027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 465/930] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:36.629214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:36.637409 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:36.638910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:36.640059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf04f796-2f03-402a-bc9c-f3a893c1aa02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154276 Jul 27 20:22:36.640667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 466/931] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:36 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:37.522134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-52e6a44e-d81e-490e-98de-5b856da05a92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:37.522779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-52e6a44e-d81e-490e-98de-5b856da05a92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:37.529317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-52e6a44e-d81e-490e-98de-5b856da05a92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:37.529770 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-52e6a44e-d81e-490e-98de-5b856da05a92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:37.530527 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-52e6a44e-d81e-490e-98de-5b856da05a92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:37.530960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-52e6a44e-d81e-490e-98de-5b856da05a92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:37.665997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-52e6a44e-d81e-490e-98de-5b856da05a92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:37.666113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:37.666113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:37.670825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-52e6a44e-d81e-490e-98de-5b856da05a92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152437 Jul 27 20:22:37.671638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 466/932] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:37.673795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:37.674688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:37.675025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:37.675454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:37.807016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:37.815956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:37.817501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:37.818656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1a0a44cc-ef57-4fb2-9315-65ce8aa6da9d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.159263 Jul 27 20:22:37.819221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 467/933] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:38.692160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c5e78d9a-f2e5-4897-8746-4add65dd89e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:38.692819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c5e78d9a-f2e5-4897-8746-4add65dd89e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:38.699293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5e78d9a-f2e5-4897-8746-4add65dd89e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:38.699745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5e78d9a-f2e5-4897-8746-4add65dd89e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:38.700534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5e78d9a-f2e5-4897-8746-4add65dd89e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:38.700973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5e78d9a-f2e5-4897-8746-4add65dd89e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:38.832260 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c5e78d9a-f2e5-4897-8746-4add65dd89e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:38.839946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c5e78d9a-f2e5-4897-8746-4add65dd89e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151719 Jul 27 20:22:38.840331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:38.840813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 467/934] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:38.840976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:38.848017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:38.848509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:38.849276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:38.849715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:38.977071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:38.985622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:38.987165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:38.988323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7250b717-00b5-428b-9fa7-4eb4c6ab46db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151946 Jul 27 20:22:38.988920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 468/935] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:38 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:39.862438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-63f55df3-b63f-4222-a98e-a83ea2da1430 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:39.863055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-63f55df3-b63f-4222-a98e-a83ea2da1430 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:39.869304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63f55df3-b63f-4222-a98e-a83ea2da1430 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:39.869784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63f55df3-b63f-4222-a98e-a83ea2da1430 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:39.870546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63f55df3-b63f-4222-a98e-a83ea2da1430 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:39.870985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63f55df3-b63f-4222-a98e-a83ea2da1430 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:40.000838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-63f55df3-b63f-4222-a98e-a83ea2da1430 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:40.008649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-63f55df3-b63f-4222-a98e-a83ea2da1430 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150931 Jul 27 20:22:40.009218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 468/936] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:40.010989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:40.011602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:40.018551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:40.018998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:40.019755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:40.020190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:40.145726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:40.154060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:40.155567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:40.156744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6dd7440d-3e27-4a60-8f73-8336c43a379f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149591 Jul 27 20:22:40.157307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 469/937] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:41.030224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7cec87fc-d528-47fb-9710-e8ddde3358a6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:41.030862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7cec87fc-d528-47fb-9710-e8ddde3358a6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:41.038395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7cec87fc-d528-47fb-9710-e8ddde3358a6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:41.039180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7cec87fc-d528-47fb-9710-e8ddde3358a6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:41.040230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7cec87fc-d528-47fb-9710-e8ddde3358a6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:41.040701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7cec87fc-d528-47fb-9710-e8ddde3358a6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:41.169130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7cec87fc-d528-47fb-9710-e8ddde3358a6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:41.177364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7cec87fc-d528-47fb-9710-e8ddde3358a6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151038 Jul 27 20:22:41.177944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 469/938] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:41 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:41.179558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:41.180171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:41.186374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:41.186834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:41.187592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:41.188029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:41.191951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:41.316804 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:41.325093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:41.326600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:41.327747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3c3bef15-a12f-4b36-b01d-741c99461e13 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152042 Jul 27 20:22:41.328310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 470/939] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:41 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:22:42.197556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-00bc843a-aedd-4f85-adfd-64597364c098 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:42.198162 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-00bc843a-aedd-4f85-adfd-64597364c098 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:42.205141 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-00bc843a-aedd-4f85-adfd-64597364c098 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:42.205583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-00bc843a-aedd-4f85-adfd-64597364c098 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:42.206322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-00bc843a-aedd-4f85-adfd-64597364c098 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:42.206795 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-00bc843a-aedd-4f85-adfd-64597364c098 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:42.334761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-00bc843a-aedd-4f85-adfd-64597364c098 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:42.342406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-00bc843a-aedd-4f85-adfd-64597364c098 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148674 Jul 27 20:22:42.342993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 470/940] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:42.350504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:42.351219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:42.357698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:42.358419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:42.359162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:42.359584 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:42.493014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:42.502007 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:42.503537 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:42.504703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e4ba559b-de72-4327-958b-da6e48a98e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.158133 Jul 27 20:22:42.505269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 471/941] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:43.363737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1f1e3ec7-e47a-4193-a624-05a3341c78b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:43.364412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1f1e3ec7-e47a-4193-a624-05a3341c78b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:43.370809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f1e3ec7-e47a-4193-a624-05a3341c78b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:43.371255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f1e3ec7-e47a-4193-a624-05a3341c78b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:43.371998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f1e3ec7-e47a-4193-a624-05a3341c78b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:43.372452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f1e3ec7-e47a-4193-a624-05a3341c78b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:43.501446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1f1e3ec7-e47a-4193-a624-05a3341c78b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:43.508986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1f1e3ec7-e47a-4193-a624-05a3341c78b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149232 Jul 27 20:22:43.510864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 471/942] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:43 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:43.526989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:43.527635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:43.534071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:43.534520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:43.535280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:43.535720 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:43.667493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:43.676788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:43.678287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:43.679434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8559f35f-2b42-4215-b1d4-eeff3c0a0f7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.156423 Jul 27 20:22:43.680228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 472/943] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:43 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:44.532893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-43564869-f0e3-460c-bbcd-0d2f789ceb98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:44.533498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-43564869-f0e3-460c-bbcd-0d2f789ceb98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:44.539711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43564869-f0e3-460c-bbcd-0d2f789ceb98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:44.540154 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43564869-f0e3-460c-bbcd-0d2f789ceb98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:44.540928 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43564869-f0e3-460c-bbcd-0d2f789ceb98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:44.541359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43564869-f0e3-460c-bbcd-0d2f789ceb98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:44.670123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-43564869-f0e3-460c-bbcd-0d2f789ceb98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:44.672291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:44.678535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-43564869-f0e3-460c-bbcd-0d2f789ceb98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151440 Jul 27 20:22:44.679122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 472/944] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:44.701870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:44.702467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:44.708942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:44.709382 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:44.710123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:44.710546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:44.834353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:44.842719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:44.844257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:44.845951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fb76d55e-18d6-4868-a00c-daf52b99a30d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.147934 Jul 27 20:22:44.846515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 473/945] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:45.700762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f8e2645a-1b90-49e1-8081-907e160b2016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:45.701378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f8e2645a-1b90-49e1-8081-907e160b2016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:45.708768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8e2645a-1b90-49e1-8081-907e160b2016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:45.709223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8e2645a-1b90-49e1-8081-907e160b2016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:45.709981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8e2645a-1b90-49e1-8081-907e160b2016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:45.710417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8e2645a-1b90-49e1-8081-907e160b2016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:45.840223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f8e2645a-1b90-49e1-8081-907e160b2016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:45.847633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f8e2645a-1b90-49e1-8081-907e160b2016 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151142 Jul 27 20:22:45.848226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 473/946] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:45.869132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:45.869684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:45.876745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:45.877194 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:45.877951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:45.878390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:46.006865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:46.015183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:46.016734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:46.017890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b29c5943-e095-4dd9-9965-a002eafc671a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152744 Jul 27 20:22:46.018456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 474/947] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:45 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:46.868879 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-77fa4837-fb37-4466-a73a-0e699dd27a12 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:46.869542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-77fa4837-fb37-4466-a73a-0e699dd27a12 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:46.876576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77fa4837-fb37-4466-a73a-0e699dd27a12 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:46.877026 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77fa4837-fb37-4466-a73a-0e699dd27a12 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:46.877772 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77fa4837-fb37-4466-a73a-0e699dd27a12 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:46.878197 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77fa4837-fb37-4466-a73a-0e699dd27a12 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:47.007974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-77fa4837-fb37-4466-a73a-0e699dd27a12 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:47.015551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-77fa4837-fb37-4466-a73a-0e699dd27a12 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150521 Jul 27 20:22:47.016121 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 474/948] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:47.040637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:47.041261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:47.048244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:47.048754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:47.049517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:47.050001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:47.178697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:47.187096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:47.188654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:47.189813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-76a21cac-89b0-4146-a1ef-f74a319737f4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153214 Jul 27 20:22:47.190390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 475/949] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:48.036774 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dc0d7758-9fc5-4b16-89f4-0ccbcb320460 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:48.037319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dc0d7758-9fc5-4b16-89f4-0ccbcb320460 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:48.043707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc0d7758-9fc5-4b16-89f4-0ccbcb320460 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:48.044149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc0d7758-9fc5-4b16-89f4-0ccbcb320460 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:48.044925 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc0d7758-9fc5-4b16-89f4-0ccbcb320460 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:48.045352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc0d7758-9fc5-4b16-89f4-0ccbcb320460 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:48.172039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dc0d7758-9fc5-4b16-89f4-0ccbcb320460 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:48.179481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dc0d7758-9fc5-4b16-89f4-0ccbcb320460 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.146606 Jul 27 20:22:48.180047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 475/950] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:48 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:48.212583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:48.213184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:48.221716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:48.222521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:48.223977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:48.224441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:48.358561 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:48.367515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:48.369088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:48.370231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aa944606-09f6-4395-ae8a-e7869538de8f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.161703 Jul 27 20:22:48.370822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 476/951] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:48 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:49.201178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b3cd09a0-a4bc-4682-943e-c71fb7cd3c10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:49.201719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b3cd09a0-a4bc-4682-943e-c71fb7cd3c10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:49.208910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3cd09a0-a4bc-4682-943e-c71fb7cd3c10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:49.209386 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3cd09a0-a4bc-4682-943e-c71fb7cd3c10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:49.210151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3cd09a0-a4bc-4682-943e-c71fb7cd3c10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:49.210593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3cd09a0-a4bc-4682-943e-c71fb7cd3c10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:49.337834 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b3cd09a0-a4bc-4682-943e-c71fb7cd3c10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:49.346319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b3cd09a0-a4bc-4682-943e-c71fb7cd3c10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149023 Jul 27 20:22:49.346949 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 476/952] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:49.393781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:49.394391 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:49.400839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:49.401286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:49.402054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:49.402479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:49.533834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:49.542162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:49.543674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:49.544854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8e204bb2-761e-4379-b804-b21046fc168d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.155517 Jul 27 20:22:49.545416 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 477/953] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:50.367901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eb09da91-8e9f-4a12-8ae1-1ce6242938aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:50.368560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eb09da91-8e9f-4a12-8ae1-1ce6242938aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:50.375062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb09da91-8e9f-4a12-8ae1-1ce6242938aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:50.375544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb09da91-8e9f-4a12-8ae1-1ce6242938aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:50.376295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb09da91-8e9f-4a12-8ae1-1ce6242938aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:50.376761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb09da91-8e9f-4a12-8ae1-1ce6242938aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:50.502969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb09da91-8e9f-4a12-8ae1-1ce6242938aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:50.510284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eb09da91-8e9f-4a12-8ae1-1ce6242938aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.146878 Jul 27 20:22:50.510851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 477/954] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:50.566956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:50.567619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:50.573995 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:50.574440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:50.575182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:50.575608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:50.705244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:50.713410 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:50.714893 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:50.716027 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-42367244-a37b-4c1b-966a-acce20f700cb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153003 Jul 27 20:22:50.716625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 478/955] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:50 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:51.531823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-44b6a436-0539-4ded-8ae4-efda57ab84c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:51.532457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-44b6a436-0539-4ded-8ae4-efda57ab84c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:51.538963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44b6a436-0539-4ded-8ae4-efda57ab84c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:51.539413 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44b6a436-0539-4ded-8ae4-efda57ab84c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:51.540174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44b6a436-0539-4ded-8ae4-efda57ab84c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:51.540642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44b6a436-0539-4ded-8ae4-efda57ab84c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:51.677187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-44b6a436-0539-4ded-8ae4-efda57ab84c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:51.684707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-44b6a436-0539-4ded-8ae4-efda57ab84c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.156756 Jul 27 20:22:51.685277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 478/956] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:51.740125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:51.740766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:51.747189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:51.747635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:51.748402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:51.748855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:51.873519 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:51.881849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:51.883368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:51.884567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c321df27-c130-4011-8dff-9c1ac90e5000 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148338 Jul 27 20:22:51.885132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 479/957] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:52.705836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0eacf8cc-2186-4b32-ac45-81bbf502d21c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:52.706382 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0eacf8cc-2186-4b32-ac45-81bbf502d21c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:52.712850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0eacf8cc-2186-4b32-ac45-81bbf502d21c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:52.713301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0eacf8cc-2186-4b32-ac45-81bbf502d21c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:52.714060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0eacf8cc-2186-4b32-ac45-81bbf502d21c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:52.714504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0eacf8cc-2186-4b32-ac45-81bbf502d21c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:52.845841 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0eacf8cc-2186-4b32-ac45-81bbf502d21c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:52.853295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0eacf8cc-2186-4b32-ac45-81bbf502d21c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152079 Jul 27 20:22:52.853863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 479/958] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:52.907088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:52.907831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:52.914456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:52.914908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:52.915668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:52.916156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:53.044291 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:53.053176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:53.054692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:53.055894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-49b3798c-60eb-4977-af27-3a1940237cfe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152690 Jul 27 20:22:53.056570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 480/959] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:52 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:53.876003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f7fa312b-f77d-414c-992a-9f44b6f90bc1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:53.876703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f7fa312b-f77d-414c-992a-9f44b6f90bc1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:53.883377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7fa312b-f77d-414c-992a-9f44b6f90bc1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:53.883822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7fa312b-f77d-414c-992a-9f44b6f90bc1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:53.884616 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7fa312b-f77d-414c-992a-9f44b6f90bc1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:53.885052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7fa312b-f77d-414c-992a-9f44b6f90bc1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:54.017367 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f7fa312b-f77d-414c-992a-9f44b6f90bc1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:54.024749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f7fa312b-f77d-414c-992a-9f44b6f90bc1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153248 Jul 27 20:22:54.025315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 480/960] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:54.079903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:54.080566 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:54.087018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:54.088977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:54.088977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:54.088977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:54.214880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:54.223043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:54.224583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:54.225716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5c9513c4-d29d-463e-a7bf-8ec1681f509c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150368 Jul 27 20:22:54.226277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 481/961] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:54 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:55.045803 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e16ed5c2-39db-4fbd-86a7-a68b35c72a8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:55.046414 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e16ed5c2-39db-4fbd-86a7-a68b35c72a8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:55.052942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e16ed5c2-39db-4fbd-86a7-a68b35c72a8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:55.053417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e16ed5c2-39db-4fbd-86a7-a68b35c72a8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:55.054173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e16ed5c2-39db-4fbd-86a7-a68b35c72a8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:55.054602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e16ed5c2-39db-4fbd-86a7-a68b35c72a8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:55.185117 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e16ed5c2-39db-4fbd-86a7-a68b35c72a8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:55.192769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e16ed5c2-39db-4fbd-86a7-a68b35c72a8c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150802 Jul 27 20:22:55.193337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 481/962] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:55.248947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:55.249656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:55.255843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:55.256288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:55.257084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:55.257515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:55.387610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:55.396526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:55.398026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:55.399162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fbd49742-c097-4d64-b48a-6c57ffb96280 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154083 Jul 27 20:22:55.399714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 482/963] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:55 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:56.214457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bb5e8c1d-5643-4ce3-9ef6-bb6f92809a61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:56.214996 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bb5e8c1d-5643-4ce3-9ef6-bb6f92809a61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:56.217298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=52 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:56.222599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb5e8c1d-5643-4ce3-9ef6-bb6f92809a61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:56.223055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb5e8c1d-5643-4ce3-9ef6-bb6f92809a61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:56.223801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb5e8c1d-5643-4ce3-9ef6-bb6f92809a61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:56.224235 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb5e8c1d-5643-4ce3-9ef6-bb6f92809a61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:56.352491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bb5e8c1d-5643-4ce3-9ef6-bb6f92809a61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:56.360810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bb5e8c1d-5643-4ce3-9ef6-bb6f92809a61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150297 Jul 27 20:22:56.361370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 482/964] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:56.421817 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:56.423051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:56.429494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:56.429946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:56.430703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:56.431140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:56.561541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:56.569769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:56.571259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:56.572410 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a72965ce-3143-42b9-af51-a137ba6517f8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154473 Jul 27 20:22:56.572976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 483/965] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:57.382317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d6d73333-8a2e-4a1d-b600-3d8ec5494329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:57.382941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d6d73333-8a2e-4a1d-b600-3d8ec5494329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:57.389396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6d73333-8a2e-4a1d-b600-3d8ec5494329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:57.389845 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6d73333-8a2e-4a1d-b600-3d8ec5494329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:57.390599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6d73333-8a2e-4a1d-b600-3d8ec5494329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:57.391035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6d73333-8a2e-4a1d-b600-3d8ec5494329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:57.517836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d6d73333-8a2e-4a1d-b600-3d8ec5494329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:57.525284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d6d73333-8a2e-4a1d-b600-3d8ec5494329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.146861 Jul 27 20:22:57.525852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 483/966] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:57.595933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:57.596491 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:57.598810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=52 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:57.603579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:57.604026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:57.604805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:57.605236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:57.733511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:57.742645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:57.744180 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:57.745371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-75a4d790-a107-4953-9b87-cacc44308162 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153964 Jul 27 20:22:57.745932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 484/967] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:58.546348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-564564b8-7eef-464d-b14f-282f70f9170f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:58.546970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-564564b8-7eef-464d-b14f-282f70f9170f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:58.553459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-564564b8-7eef-464d-b14f-282f70f9170f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:58.553907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-564564b8-7eef-464d-b14f-282f70f9170f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:58.554661 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-564564b8-7eef-464d-b14f-282f70f9170f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:58.555094 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-564564b8-7eef-464d-b14f-282f70f9170f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:58.683394 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-564564b8-7eef-464d-b14f-282f70f9170f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:58.691064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-564564b8-7eef-464d-b14f-282f70f9170f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148577 Jul 27 20:22:58.691638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 484/968] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:58.768277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:58.768924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:58.775310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:58.775760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:58.776560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:58.776998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:58.901464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:58.909754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:58.911267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:58.912458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5cf1fd3e-cf3e-4580-b09f-7a261eb1acac tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148516 Jul 27 20:22:58.913025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 485/969] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:58 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:22:59.716753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a4cebfe4-b316-4a74-b31b-eaac4980113c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:59.716753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a4cebfe4-b316-4a74-b31b-eaac4980113c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:59.720310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4cebfe4-b316-4a74-b31b-eaac4980113c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:59.720821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4cebfe4-b316-4a74-b31b-eaac4980113c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:59.721573 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4cebfe4-b316-4a74-b31b-eaac4980113c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:59.722002 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4cebfe4-b316-4a74-b31b-eaac4980113c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:59.855215 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a4cebfe4-b316-4a74-b31b-eaac4980113c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:22:59.862806 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a4cebfe4-b316-4a74-b31b-eaac4980113c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.154474 Jul 27 20:22:59.863376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 485/970] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:22:59 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:22:59.935452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:22:59.936052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:22:59.943173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:59.943616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:22:59.944364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:22:59.944829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:00.069633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:00.073038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:00.078854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:00.080366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:00.085227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3ec94253-bf03-431a-ab82-364336e1c060 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150013 Jul 27 20:23:00.085227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 486/971] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:22:59 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:00.884326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ffee3ee1-7ef5-426d-9d79-6acc7af6ce91 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:00.884944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ffee3ee1-7ef5-426d-9d79-6acc7af6ce91 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:00.891094 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ffee3ee1-7ef5-426d-9d79-6acc7af6ce91 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:00.891536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ffee3ee1-7ef5-426d-9d79-6acc7af6ce91 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:00.892282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ffee3ee1-7ef5-426d-9d79-6acc7af6ce91 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:00.892737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ffee3ee1-7ef5-426d-9d79-6acc7af6ce91 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.023309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ffee3ee1-7ef5-426d-9d79-6acc7af6ce91 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:01.030848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ffee3ee1-7ef5-426d-9d79-6acc7af6ce91 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150381 Jul 27 20:23:01.032084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 486/972] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:01.105819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:01.106430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:01.113780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.114228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.114982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.115420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.240096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:01.248419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:01.250014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:01.251342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-66963db6-0c66-4ed0-824c-b61d1564c014 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149227 Jul 27 20:23:01.252155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 487/973] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:02.052503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f0c41d5-5309-4726-9dbb-8a3dd4df1f37 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:02.053111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6f0c41d5-5309-4726-9dbb-8a3dd4df1f37 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:02.059564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f0c41d5-5309-4726-9dbb-8a3dd4df1f37 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:02.060007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f0c41d5-5309-4726-9dbb-8a3dd4df1f37 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:02.060801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f0c41d5-5309-4726-9dbb-8a3dd4df1f37 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:02.061228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f0c41d5-5309-4726-9dbb-8a3dd4df1f37 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:02.189066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6f0c41d5-5309-4726-9dbb-8a3dd4df1f37 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:02.196415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6f0c41d5-5309-4726-9dbb-8a3dd4df1f37 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147794 Jul 27 20:23:02.196976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 487/974] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:02 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:02.275757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:02.276364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:02.282869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:02.283311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:02.284060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:02.284523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:02.411573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:02.419770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:02.421307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:02.422455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-424e4c1c-41ef-4611-bf56-34fe24cef33e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150634 Jul 27 20:23:02.423025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 488/975] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:02 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:03.218603 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ad335366-4afe-437e-bcc6-cdfa56dc1b61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:03.219155 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ad335366-4afe-437e-bcc6-cdfa56dc1b61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:03.225606 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad335366-4afe-437e-bcc6-cdfa56dc1b61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:03.226052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad335366-4afe-437e-bcc6-cdfa56dc1b61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:03.226807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad335366-4afe-437e-bcc6-cdfa56dc1b61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:03.227240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad335366-4afe-437e-bcc6-cdfa56dc1b61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:03.359488 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ad335366-4afe-437e-bcc6-cdfa56dc1b61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:03.367006 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ad335366-4afe-437e-bcc6-cdfa56dc1b61 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152394 Jul 27 20:23:03.367574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 488/976] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:03.447806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:03.448435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:03.454999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:03.455446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:03.456202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:03.456682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:03.589106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:03.598033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:03.599853 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:03.601458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fbc364f6-6637-4c5b-a78c-41ac73a498e2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.157181 Jul 27 20:23:03.605393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 489/977] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:04.388631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cdffeb11-7996-45e5-86fa-e19c408f4d93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:04.389245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cdffeb11-7996-45e5-86fa-e19c408f4d93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:04.396320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cdffeb11-7996-45e5-86fa-e19c408f4d93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:04.396798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cdffeb11-7996-45e5-86fa-e19c408f4d93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:04.397558 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cdffeb11-7996-45e5-86fa-e19c408f4d93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:04.397992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cdffeb11-7996-45e5-86fa-e19c408f4d93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:04.412217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:04.526534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cdffeb11-7996-45e5-86fa-e19c408f4d93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:04.534025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cdffeb11-7996-45e5-86fa-e19c408f4d93 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149339 Jul 27 20:23:04.534590 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 489/978] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:04.629990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:04.630520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:04.636858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:04.637297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:04.638041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:04.638463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:04.766508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:04.774736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:04.776230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:04.777435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b35ebbf2-3de8-4526-8a13-d331358ec1ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.151404 Jul 27 20:23:04.777993 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 490/979] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:04 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:05.555179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6bf41074-9b07-44f7-ae2b-df78ea1d9093 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:05.555792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6bf41074-9b07-44f7-ae2b-df78ea1d9093 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:05.562447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6bf41074-9b07-44f7-ae2b-df78ea1d9093 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:05.562894 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6bf41074-9b07-44f7-ae2b-df78ea1d9093 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:05.563651 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6bf41074-9b07-44f7-ae2b-df78ea1d9093 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:05.564084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6bf41074-9b07-44f7-ae2b-df78ea1d9093 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:05.690930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6bf41074-9b07-44f7-ae2b-df78ea1d9093 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:05.698341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6bf41074-9b07-44f7-ae2b-df78ea1d9093 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147047 Jul 27 20:23:05.698909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 490/980] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:05.800654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:05.801263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:05.807711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:05.808096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:05.808898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:05.809332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:05.934636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:05.942901 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:05.944435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:05.945594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5de86d1f-3986-4c61-b567-2f5943562294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149474 Jul 27 20:23:05.946160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 491/981] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:05 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:06.719964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-986ef654-e6db-482f-a4fc-d7ae7127744d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:06.720522 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-986ef654-e6db-482f-a4fc-d7ae7127744d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:06.726986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-986ef654-e6db-482f-a4fc-d7ae7127744d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:06.727437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-986ef654-e6db-482f-a4fc-d7ae7127744d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:06.728193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-986ef654-e6db-482f-a4fc-d7ae7127744d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:06.728668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-986ef654-e6db-482f-a4fc-d7ae7127744d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:06.859924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-986ef654-e6db-482f-a4fc-d7ae7127744d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:06.867451 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-986ef654-e6db-482f-a4fc-d7ae7127744d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152031 Jul 27 20:23:06.868023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 491/982] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:06.974470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:06.975124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:06.981636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:06.982328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:06.983091 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:06.983522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:07.121701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:07.130019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:07.131518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:07.132768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d4049cc7-2948-4957-81aa-4424831bd5a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.162235 Jul 27 20:23:07.133364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 492/983] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:06 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:07.888418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-34abc9ac-6e07-4129-a344-780e8ecc4309 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:07.889036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-34abc9ac-6e07-4129-a344-780e8ecc4309 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:07.895464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34abc9ac-6e07-4129-a344-780e8ecc4309 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:07.895914 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34abc9ac-6e07-4129-a344-780e8ecc4309 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:07.896701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34abc9ac-6e07-4129-a344-780e8ecc4309 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:07.897139 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34abc9ac-6e07-4129-a344-780e8ecc4309 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:08.028905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-34abc9ac-6e07-4129-a344-780e8ecc4309 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:08.036494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-34abc9ac-6e07-4129-a344-780e8ecc4309 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151953 Jul 27 20:23:08.037065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 492/984] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:08.156610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:08.157155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:08.163602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:08.164053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:08.164852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:08.165288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:08.289054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:08.298041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:08.299556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:08.300741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d537df90-68c9-4671-8468-e97b057dae75 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148586 Jul 27 20:23:08.301329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 493/985] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:08 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:09.058111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4e73e2c7-eae6-4c5a-b091-59d0d3ab1267 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:09.058835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4e73e2c7-eae6-4c5a-b091-59d0d3ab1267 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:09.065895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e73e2c7-eae6-4c5a-b091-59d0d3ab1267 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:09.066349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e73e2c7-eae6-4c5a-b091-59d0d3ab1267 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:09.067113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e73e2c7-eae6-4c5a-b091-59d0d3ab1267 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:09.067553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e73e2c7-eae6-4c5a-b091-59d0d3ab1267 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:09.195189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4e73e2c7-eae6-4c5a-b091-59d0d3ab1267 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:09.202548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4e73e2c7-eae6-4c5a-b091-59d0d3ab1267 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148464 Jul 27 20:23:09.203105 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 493/986] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:09 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:09.323676 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:09.324204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:09.331518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:09.331969 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:09.332763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:09.333206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:09.461422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:09.470375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:09.471870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:09.473047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-05d92281-2d55-4a2b-9d34-6ac62121553c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153527 Jul 27 20:23:09.473602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 494/987] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:10.223714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-629a9241-b65e-49d2-9da3-5a920448ebbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:10.224252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-629a9241-b65e-49d2-9da3-5a920448ebbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:10.230668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-629a9241-b65e-49d2-9da3-5a920448ebbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:10.231108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-629a9241-b65e-49d2-9da3-5a920448ebbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:10.231849 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-629a9241-b65e-49d2-9da3-5a920448ebbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:10.232570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-629a9241-b65e-49d2-9da3-5a920448ebbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:10.358672 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-629a9241-b65e-49d2-9da3-5a920448ebbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:10.366099 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-629a9241-b65e-49d2-9da3-5a920448ebbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.146368 Jul 27 20:23:10.366667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 494/988] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:10.501490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:10.502107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:10.508589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:10.509037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:10.509787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:10.510217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:10.640346 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:10.648710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:10.650232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:10.651391 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ee6bb7c3-d864-4e62-a2bf-bd04525351ed tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.154264 Jul 27 20:23:10.651956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 495/989] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:11.387740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d6324bab-c403-4922-9f02-c06ded248bb7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:11.388355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d6324bab-c403-4922-9f02-c06ded248bb7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:11.395514 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6324bab-c403-4922-9f02-c06ded248bb7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:11.395972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6324bab-c403-4922-9f02-c06ded248bb7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:11.396777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6324bab-c403-4922-9f02-c06ded248bb7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:11.397214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6324bab-c403-4922-9f02-c06ded248bb7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:11.522464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d6324bab-c403-4922-9f02-c06ded248bb7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:11.529881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d6324bab-c403-4922-9f02-c06ded248bb7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.146015 Jul 27 20:23:11.530452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 495/990] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:23:11.674586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:11.675153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:11.681639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:11.682088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:11.682846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:11.683279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:11.808779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:11.817623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:11.819141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:11.820289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f9f4f2d2-733a-4a41-83c1-d22c51b257fd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150250 Jul 27 20:23:11.820886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 496/991] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:11 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:12.551683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3bfc0392-7e72-4ca1-9235-fe756f38d986 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:12.552300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3bfc0392-7e72-4ca1-9235-fe756f38d986 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:12.558765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3bfc0392-7e72-4ca1-9235-fe756f38d986 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:12.559221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3bfc0392-7e72-4ca1-9235-fe756f38d986 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:12.559980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3bfc0392-7e72-4ca1-9235-fe756f38d986 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:12.560447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3bfc0392-7e72-4ca1-9235-fe756f38d986 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:12.687798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3bfc0392-7e72-4ca1-9235-fe756f38d986 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:12.695326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3bfc0392-7e72-4ca1-9235-fe756f38d986 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147560 Jul 27 20:23:12.695904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 496/992] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:12.843198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:12.844452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:12.850951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:12.851399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:12.852187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:12.852654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:12.977390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:12.986713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:12.989229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:12.989613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1c8674df-fb84-426a-a1bd-73b0170d51ef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150754 Jul 27 20:23:12.990255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 497/993] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:12 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:13.716540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c957c91e-42fb-480f-820c-9dd0351db591 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:13.717162 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c957c91e-42fb-480f-820c-9dd0351db591 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:13.723548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c957c91e-42fb-480f-820c-9dd0351db591 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:13.723993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c957c91e-42fb-480f-820c-9dd0351db591 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:13.724782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c957c91e-42fb-480f-820c-9dd0351db591 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:13.725220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c957c91e-42fb-480f-820c-9dd0351db591 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:13.855997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c957c91e-42fb-480f-820c-9dd0351db591 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:13.864260 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c957c91e-42fb-480f-820c-9dd0351db591 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151759 Jul 27 20:23:13.864858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 497/994] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:14.012371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:14.013021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:14.019619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:14.020140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:14.020957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:14.021394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:14.200906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:14.209111 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:14.210604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:14.211744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-45acd77b-2900-4a85-9e72-467add4190df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.203480 Jul 27 20:23:14.212310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 498/995] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:14 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:14.886131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-19e9ba2a-9f72-491b-a095-68d0d9a76d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:14.886749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-19e9ba2a-9f72-491b-a095-68d0d9a76d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:14.893979 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19e9ba2a-9f72-491b-a095-68d0d9a76d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:14.894436 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19e9ba2a-9f72-491b-a095-68d0d9a76d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:14.895196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19e9ba2a-9f72-491b-a095-68d0d9a76d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:14.895668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19e9ba2a-9f72-491b-a095-68d0d9a76d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:15.070979 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-19e9ba2a-9f72-491b-a095-68d0d9a76d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:15.079071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-19e9ba2a-9f72-491b-a095-68d0d9a76d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.196865 Jul 27 20:23:15.079648 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 498/996] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:15.234655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:15.235270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:15.241663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:15.242107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:15.242861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:15.243288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:15.367606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:15.376999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:15.379158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:15.380710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2d49a554-21e7-4bd1-ac00-b6cd08a6c03d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150487 Jul 27 20:23:15.381709 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 499/997] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:16.099988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e69e28b0-f8fe-4a72-a1fb-03261b07072b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:16.100618 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e69e28b0-f8fe-4a72-a1fb-03261b07072b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:16.107394 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e69e28b0-f8fe-4a72-a1fb-03261b07072b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:16.107839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e69e28b0-f8fe-4a72-a1fb-03261b07072b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:16.108622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e69e28b0-f8fe-4a72-a1fb-03261b07072b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:16.109051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e69e28b0-f8fe-4a72-a1fb-03261b07072b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:16.238165 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e69e28b0-f8fe-4a72-a1fb-03261b07072b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:16.245766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e69e28b0-f8fe-4a72-a1fb-03261b07072b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149625 Jul 27 20:23:16.246330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 499/998] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:16.403790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:16.404445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:16.411645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:16.412100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:16.412884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:16.413321 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:16.541451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:16.549814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:16.551345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:16.552530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eea3f375-1026-4f2a-bdee-b6fe859ef93e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152715 Jul 27 20:23:16.553094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 500/999] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:16 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:17.266862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a6dceac2-cb91-44d6-a16c-aa3b94a77acc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:17.267465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a6dceac2-cb91-44d6-a16c-aa3b94a77acc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:17.273888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a6dceac2-cb91-44d6-a16c-aa3b94a77acc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:17.274334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a6dceac2-cb91-44d6-a16c-aa3b94a77acc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:17.275083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a6dceac2-cb91-44d6-a16c-aa3b94a77acc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:17.275511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a6dceac2-cb91-44d6-a16c-aa3b94a77acc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:17.403286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a6dceac2-cb91-44d6-a16c-aa3b94a77acc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:17.412004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a6dceac2-cb91-44d6-a16c-aa3b94a77acc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148935 Jul 27 20:23:17.418199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 500/1000] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:17.575098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:17.575703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:17.582858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:17.583308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:17.584070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:17.584531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:17.714459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:17.725549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:17.727061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:17.728230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-64a2886b-d3b3-4424-b671-b20526693dab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.157080 Jul 27 20:23:17.728827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 501/1001] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:18.434221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f325356f-825e-4db1-827f-d0b8781b4f0d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:18.434829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f325356f-825e-4db1-827f-d0b8781b4f0d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:18.442021 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f325356f-825e-4db1-827f-d0b8781b4f0d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:18.442469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f325356f-825e-4db1-827f-d0b8781b4f0d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:18.443219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f325356f-825e-4db1-827f-d0b8781b4f0d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:18.443649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f325356f-825e-4db1-827f-d0b8781b4f0d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:18.572263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f325356f-825e-4db1-827f-d0b8781b4f0d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:18.579690 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f325356f-825e-4db1-827f-d0b8781b4f0d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149287 Jul 27 20:23:18.580257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 501/1002] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:18.751178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:18.751797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:18.758206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:18.758641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:18.759381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:18.759810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:18.886229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:18.894802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:18.896308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:18.897539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fdd95f12-5502-46c7-b287-3225da5acbb6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150429 Jul 27 20:23:18.898134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 502/1003] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:18 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:19.600999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7901e691-0d07-455c-b950-883ca75835cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:19.601549 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7901e691-0d07-455c-b950-883ca75835cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:19.608241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7901e691-0d07-455c-b950-883ca75835cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:19.608732 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7901e691-0d07-455c-b950-883ca75835cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:19.609490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7901e691-0d07-455c-b950-883ca75835cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:19.609927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7901e691-0d07-455c-b950-883ca75835cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:19.738944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7901e691-0d07-455c-b950-883ca75835cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:19.746374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7901e691-0d07-455c-b950-883ca75835cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149306 Jul 27 20:23:19.746939 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 502/1004] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:19.921472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:19.921987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:19.928514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:19.928969 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:19.929757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:19.930195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:19.948276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:20.057830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:20.066695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:20.068201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:20.069389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-19b16449-0bfc-4130-9258-d47fe2651d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.152400 Jul 27 20:23:20.069950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 503/1005] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:19 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:20.769965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5a8a9202-a617-4f87-ba66-b8ad3f9c8989 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:20.770572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5a8a9202-a617-4f87-ba66-b8ad3f9c8989 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:20.777014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a8a9202-a617-4f87-ba66-b8ad3f9c8989 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:20.777452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a8a9202-a617-4f87-ba66-b8ad3f9c8989 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:20.778196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a8a9202-a617-4f87-ba66-b8ad3f9c8989 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:20.778623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a8a9202-a617-4f87-ba66-b8ad3f9c8989 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:20.910362 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5a8a9202-a617-4f87-ba66-b8ad3f9c8989 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:20.917840 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5a8a9202-a617-4f87-ba66-b8ad3f9c8989 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.154045 Jul 27 20:23:20.918416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 503/1006] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:21.091984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:21.092548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:21.098979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:21.099430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:21.100190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:21.100662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:21.226622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:21.235632 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:21.237194 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:21.238351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-220aaa70-984f-4917-91b8-9cf0f22ccf0e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.150408 Jul 27 20:23:21.238914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 504/1007] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:21.938385 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-69ef038e-bcfd-4195-83bf-3204ca5af91f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:21.939030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-69ef038e-bcfd-4195-83bf-3204ca5af91f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:21.945521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69ef038e-bcfd-4195-83bf-3204ca5af91f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:21.945974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69ef038e-bcfd-4195-83bf-3204ca5af91f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:21.946735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69ef038e-bcfd-4195-83bf-3204ca5af91f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:21.947166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69ef038e-bcfd-4195-83bf-3204ca5af91f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:22.261652 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:22.266109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:22.269482 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:22.269932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:22.270704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:22.271132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:22.324291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-69ef038e-bcfd-4195-83bf-3204ca5af91f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:22.332320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-69ef038e-bcfd-4195-83bf-3204ca5af91f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.397763 Jul 27 20:23:22.333116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 504/1008] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:22.406750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:22.414998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:22.416560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:22.417693 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e624a8cf-038d-40f0-b4f0-ed50da1594de tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.160036 Jul 27 20:23:22.418253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 505/1009] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:23.354244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bd6a76f6-1813-45c2-9453-08ed000df20a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:23.354863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bd6a76f6-1813-45c2-9453-08ed000df20a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:23.362347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd6a76f6-1813-45c2-9453-08ed000df20a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:23.362797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd6a76f6-1813-45c2-9453-08ed000df20a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:23.363556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd6a76f6-1813-45c2-9453-08ed000df20a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:23.363993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd6a76f6-1813-45c2-9453-08ed000df20a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:23.440707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:23.441082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:23.447482 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:23.447927 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:23.448724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:23.449157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:23.504719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bd6a76f6-1813-45c2-9453-08ed000df20a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:23.519731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bd6a76f6-1813-45c2-9453-08ed000df20a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.169358 Jul 27 20:23:23.520328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 505/1010] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:23.586771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:23.595792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:23.597274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:23.598423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-66e9ccd8-2e4a-45d0-b753-da6c16774af1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.161943 Jul 27 20:23:23.598990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 506/1011] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:23 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:24.541779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-85192b61-dbc6-40ae-b900-4791227e2b51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:24.542393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-85192b61-dbc6-40ae-b900-4791227e2b51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:24.549391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85192b61-dbc6-40ae-b900-4791227e2b51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:24.549833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85192b61-dbc6-40ae-b900-4791227e2b51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:24.550589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85192b61-dbc6-40ae-b900-4791227e2b51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:24.551025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85192b61-dbc6-40ae-b900-4791227e2b51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:24.553567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:24.621416 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:24.621960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:24.628364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:24.628850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:24.629613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:24.630053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:24.691004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-85192b61-dbc6-40ae-b900-4791227e2b51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:24.698451 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-85192b61-dbc6-40ae-b900-4791227e2b51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.160588 Jul 27 20:23:24.699024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 506/1012] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:24.771593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:24.780639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:24.782157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:24.783322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-90f757c0-22b4-4a1b-8d60-2ef439d2d41e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.165913 Jul 27 20:23:24.783897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 507/1013] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:24 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:23:25.719904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-afe4071d-6e62-4525-8b73-57feca18621e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:25.720469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-afe4071d-6e62-4525-8b73-57feca18621e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:25.726958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-afe4071d-6e62-4525-8b73-57feca18621e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:25.727412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-afe4071d-6e62-4525-8b73-57feca18621e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:25.728168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-afe4071d-6e62-4525-8b73-57feca18621e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:25.728638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-afe4071d-6e62-4525-8b73-57feca18621e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:25.806763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:25.807365 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:25.815471 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:25.816252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:25.817681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:25.818257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:25.871491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-afe4071d-6e62-4525-8b73-57feca18621e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:25.879612 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-afe4071d-6e62-4525-8b73-57feca18621e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.163722 Jul 27 20:23:25.880190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 507/1014] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:25.955370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:25.963970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:25.965528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:25.966695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-388254b6-1bbf-46d4-b338-582fa908d606 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.164000 Jul 27 20:23:25.967257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 508/1015] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:25 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:26.900902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bc1436d7-525c-47e2-a575-0954d99804bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:26.901548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bc1436d7-525c-47e2-a575-0954d99804bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:26.903971 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=52 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:26.909157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bc1436d7-525c-47e2-a575-0954d99804bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:26.909612 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bc1436d7-525c-47e2-a575-0954d99804bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:26.910379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bc1436d7-525c-47e2-a575-0954d99804bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:26.910821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bc1436d7-525c-47e2-a575-0954d99804bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:26.989645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:26.990855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:26.997303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:26.997746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:26.999001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:26.999426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:27.088578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bc1436d7-525c-47e2-a575-0954d99804bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:27.096282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bc1436d7-525c-47e2-a575-0954d99804bf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.199187 Jul 27 20:23:27.096886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 508/1016] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:27.152943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:27.161131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:27.162618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:27.163784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2ba602d9-6338-4020-aabe-e3917babd673 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.178072 Jul 27 20:23:27.164398 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 509/1017] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:26 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:28.118232 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-46059664-3092-422a-b2e7-ee5a7e104308 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:28.118782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-46059664-3092-422a-b2e7-ee5a7e104308 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:28.125243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-46059664-3092-422a-b2e7-ee5a7e104308 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:28.125706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-46059664-3092-422a-b2e7-ee5a7e104308 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:28.126455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-46059664-3092-422a-b2e7-ee5a7e104308 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:28.126893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-46059664-3092-422a-b2e7-ee5a7e104308 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:28.186649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:28.187259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:28.189660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=52 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:28.194447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:28.194851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:28.197798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:28.197798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:28.289085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-46059664-3092-422a-b2e7-ee5a7e104308 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:28.296415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-46059664-3092-422a-b2e7-ee5a7e104308 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.182120 Jul 27 20:23:28.296981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 509/1018] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:28.349477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:28.358038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:28.359532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:28.360710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f621758f-0f65-4edd-9a7f-ed23e7dc180f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.178019 Jul 27 20:23:28.361266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 510/1019] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:28 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:29.218630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:23:29.219406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:23:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:23:29.317633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f9896933-e636-47bd-b26b-2111185b949e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:29.318275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f9896933-e636-47bd-b26b-2111185b949e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:29.324802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9896933-e636-47bd-b26b-2111185b949e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:29.325247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9896933-e636-47bd-b26b-2111185b949e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:29.326001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9896933-e636-47bd-b26b-2111185b949e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:29.326433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9896933-e636-47bd-b26b-2111185b949e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:29.383169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:29.383781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:29.390502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:29.390955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:29.391716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:29.392152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:29.496349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9896933-e636-47bd-b26b-2111185b949e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:29.504292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f9896933-e636-47bd-b26b-2111185b949e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.190431 Jul 27 20:23:29.505034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 510/1020] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:23:29.549026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:29.557521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:29.559041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:29.560192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3321dcb5-1570-4f56-bb1f-3e8e61e0e02b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.181076 Jul 27 20:23:29.560807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 511/1021] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:29 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:29.814585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:23:29.814770 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:23:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:23:30.528124 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a5d45d36-342d-47b9-9662-15a166fc26bd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:30.528959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a5d45d36-342d-47b9-9662-15a166fc26bd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:30.538224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5d45d36-342d-47b9-9662-15a166fc26bd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:30.538698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5d45d36-342d-47b9-9662-15a166fc26bd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:30.539619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5d45d36-342d-47b9-9662-15a166fc26bd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:30.540061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5d45d36-342d-47b9-9662-15a166fc26bd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:30.582316 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:30.582977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:30.589488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:30.589929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:30.590682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:30.591106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:30.729321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a5d45d36-342d-47b9-9662-15a166fc26bd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:30.737567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a5d45d36-342d-47b9-9662-15a166fc26bd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.215076 Jul 27 20:23:30.738355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 511/1022] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:30.759156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:30.768580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:30.770070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:30.771213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fdbfdb75-e87a-4a61-8c88-35c69e5c9542 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.192784 Jul 27 20:23:30.771766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 512/1023] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:31.759119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cf1b3a19-7716-4df3-bdbc-397845b98dae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:31.759733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cf1b3a19-7716-4df3-bdbc-397845b98dae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:31.766796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf1b3a19-7716-4df3-bdbc-397845b98dae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:31.767251 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf1b3a19-7716-4df3-bdbc-397845b98dae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:31.768009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf1b3a19-7716-4df3-bdbc-397845b98dae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:31.768477 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf1b3a19-7716-4df3-bdbc-397845b98dae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:31.794550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:31.795157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:31.801653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:31.802078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:31.802827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:31.803254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:31.949641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cf1b3a19-7716-4df3-bdbc-397845b98dae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:31.958481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cf1b3a19-7716-4df3-bdbc-397845b98dae tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.203245 Jul 27 20:23:31.959460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 512/1024] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:31.978300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:31.987066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:31.988472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:31.989878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a52fd180-f06c-4df9-9656-37af666754a5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.199164 Jul 27 20:23:31.990453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 513/1025] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:31 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:32.980574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-40575292-a65d-4a81-81e5-6dbdfef2aa28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:32.981560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-40575292-a65d-4a81-81e5-6dbdfef2aa28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:32.988663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40575292-a65d-4a81-81e5-6dbdfef2aa28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:32.989110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40575292-a65d-4a81-81e5-6dbdfef2aa28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:32.989920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40575292-a65d-4a81-81e5-6dbdfef2aa28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:32.990356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40575292-a65d-4a81-81e5-6dbdfef2aa28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:33.011774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:33.012419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:33.019903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:33.020453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:33.021236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:33.021669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:33.181372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-40575292-a65d-4a81-81e5-6dbdfef2aa28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:33.189031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-40575292-a65d-4a81-81e5-6dbdfef2aa28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.212453 Jul 27 20:23:33.189598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 513/1026] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:33.206749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:33.214971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:33.216647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:33.218439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6d72fd79-fc5c-4213-bb40-ca554ba71c18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.210786 Jul 27 20:23:33.219002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 514/1027] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:33 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:34.209871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3c2c8b14-c30c-4c53-be15-cd29e2229426 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:34.210475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3c2c8b14-c30c-4c53-be15-cd29e2229426 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:34.216915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c2c8b14-c30c-4c53-be15-cd29e2229426 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:34.217364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c2c8b14-c30c-4c53-be15-cd29e2229426 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:34.218114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c2c8b14-c30c-4c53-be15-cd29e2229426 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:34.218548 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3c2c8b14-c30c-4c53-be15-cd29e2229426 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:34.241098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:34.241955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:34.249027 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:34.249482 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:34.250252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:34.251214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:34.400930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3c2c8b14-c30c-4c53-be15-cd29e2229426 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:34.408977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3c2c8b14-c30c-4c53-be15-cd29e2229426 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.202963 Jul 27 20:23:34.412838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 514/1028] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:34.428465 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:34.436797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:34.438305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:34.439449 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-58aa5b56-76df-4606-912b-8f3b113fb37d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.202301 Jul 27 20:23:34.440004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 515/1029] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:35.430439 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5228efa4-528c-4e88-ac51-7a86859487cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:35.431048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5228efa4-528c-4e88-ac51-7a86859487cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:35.437938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5228efa4-528c-4e88-ac51-7a86859487cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:35.438383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5228efa4-528c-4e88-ac51-7a86859487cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:35.439126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5228efa4-528c-4e88-ac51-7a86859487cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:35.439555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5228efa4-528c-4e88-ac51-7a86859487cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:35.466033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:35.466643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:35.473195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:35.473651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:35.474413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:35.474844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:35.622562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5228efa4-528c-4e88-ac51-7a86859487cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:35.630622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5228efa4-528c-4e88-ac51-7a86859487cc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.204019 Jul 27 20:23:35.631190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 515/1030] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:35 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:35.649059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:35.657372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:35.658895 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:35.660045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-30986d2e-c279-4a94-b50f-9251da6f0294 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.198058 Jul 27 20:23:35.660647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 516/1031] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:35 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:36.651750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5e5f653b-b09a-4990-bc06-90d6eeef67c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:36.652291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5e5f653b-b09a-4990-bc06-90d6eeef67c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:36.658766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e5f653b-b09a-4990-bc06-90d6eeef67c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:36.659208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e5f653b-b09a-4990-bc06-90d6eeef67c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:36.659953 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e5f653b-b09a-4990-bc06-90d6eeef67c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:36.660394 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e5f653b-b09a-4990-bc06-90d6eeef67c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:36.682913 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:36.683559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:36.690778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:36.691235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:36.692006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:36.692474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:36.855328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5e5f653b-b09a-4990-bc06-90d6eeef67c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:36.862257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:36.863116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5e5f653b-b09a-4990-bc06-90d6eeef67c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.215237 Jul 27 20:23:36.863699 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 516/1032] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:36.870840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:36.872348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:36.874099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1e73dc01-c22d-4af4-9952-64bd6496d024 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.194473 Jul 27 20:23:36.874814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 517/1033] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:36 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:37.884642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e9c3553d-812d-4d12-b52a-72759104789c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:37.885318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e9c3553d-812d-4d12-b52a-72759104789c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:37.893528 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9c3553d-812d-4d12-b52a-72759104789c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:37.896642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9c3553d-812d-4d12-b52a-72759104789c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:37.896642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9c3553d-812d-4d12-b52a-72759104789c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:37.896642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9c3553d-812d-4d12-b52a-72759104789c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:37.896946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:37.897339 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:37.903607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:37.904054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:37.905541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:37.905976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:38.096594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e9c3553d-812d-4d12-b52a-72759104789c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:38.100437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:38.104032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e9c3553d-812d-4d12-b52a-72759104789c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.223404 Jul 27 20:23:38.104627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 517/1034] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:38.109185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:38.110707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:38.111861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6427e37a-fa81-4645-ae26-a48a0901a0b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.219365 Jul 27 20:23:38.112493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 518/1035] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:39.125085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5e0f590e-a81e-4cea-b4b8-c2f5920b7275 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:39.125713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5e0f590e-a81e-4cea-b4b8-c2f5920b7275 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:39.132209 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e0f590e-a81e-4cea-b4b8-c2f5920b7275 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:39.132683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e0f590e-a81e-4cea-b4b8-c2f5920b7275 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:39.133459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e0f590e-a81e-4cea-b4b8-c2f5920b7275 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:39.133885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e0f590e-a81e-4cea-b4b8-c2f5920b7275 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:39.134864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:39.135475 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:39.142669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:39.143114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:39.143869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:39.144303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:39.333309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:39.334333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5e0f590e-a81e-4cea-b4b8-c2f5920b7275 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:39.341663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5e0f590e-a81e-4cea-b4b8-c2f5920b7275 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.220953 Jul 27 20:23:39.342816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 518/1036] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:39.342966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:39.344401 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:39.345558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8edcad4b-81f2-4ba6-aa09-fcf7f1b7a7af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.214536 Jul 27 20:23:39.346134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 519/1037] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:39 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:40.363882 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-90bc3ef0-0022-48ea-9e8e-5432dedefcbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:40.364561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-90bc3ef0-0022-48ea-9e8e-5432dedefcbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:40.368064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:40.368701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:40.370937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90bc3ef0-0022-48ea-9e8e-5432dedefcbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:40.371379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90bc3ef0-0022-48ea-9e8e-5432dedefcbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:40.372132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90bc3ef0-0022-48ea-9e8e-5432dedefcbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:40.372595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90bc3ef0-0022-48ea-9e8e-5432dedefcbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:40.375040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:40.375487 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:40.376243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:40.377336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:40.381420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:40.568115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90bc3ef0-0022-48ea-9e8e-5432dedefcbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:40.571352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:40.575563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-90bc3ef0-0022-48ea-9e8e-5432dedefcbd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.215695 Jul 27 20:23:40.576135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 519/1038] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:40 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:40.579792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:40.581362 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:40.582518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d57430fd-7569-464b-ac7a-c558ce08d99c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.218387 Jul 27 20:23:40.583068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 520/1039] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:41.597524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-85f697d0-4dd4-4b40-830b-e6fd8c053d2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:41.598050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-85f697d0-4dd4-4b40-830b-e6fd8c053d2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:41.604603 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85f697d0-4dd4-4b40-830b-e6fd8c053d2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:41.605061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85f697d0-4dd4-4b40-830b-e6fd8c053d2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:41.605624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:41.606286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85f697d0-4dd4-4b40-830b-e6fd8c053d2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:41.606506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85f697d0-4dd4-4b40-830b-e6fd8c053d2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:41.606662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:41.613528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:41.613972 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:41.614730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:41.615165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:41.795375 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-85f697d0-4dd4-4b40-830b-e6fd8c053d2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:41.802052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:41.803257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-85f697d0-4dd4-4b40-830b-e6fd8c053d2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.209727 Jul 27 20:23:41.803932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 520/1040] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:41 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:41.810402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:41.812521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:41.813682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0d6e7a33-b924-45fb-a023-4c8a0841c38a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.211839 Jul 27 20:23:41.814237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 521/1041] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:41 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:42.824768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b0289956-54c0-46c7-b560-83ede029a791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:42.825386 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b0289956-54c0-46c7-b560-83ede029a791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:42.831790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0289956-54c0-46c7-b560-83ede029a791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:42.832234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0289956-54c0-46c7-b560-83ede029a791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:42.833009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0289956-54c0-46c7-b560-83ede029a791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:42.833435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0289956-54c0-46c7-b560-83ede029a791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:42.835983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:42.836627 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:42.843603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:42.844054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:42.844841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:42.845280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:43.031649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b0289956-54c0-46c7-b560-83ede029a791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:43.035456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:43.039513 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b0289956-54c0-46c7-b560-83ede029a791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.218517 Jul 27 20:23:43.040090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 521/1042] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:43.043716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:43.046029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:43.047198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5e8e723a-d869-432e-bcc6-1db9db24db6b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.215070 Jul 27 20:23:43.047892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 522/1043] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:44.063016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cd89908b-8ec9-4867-bd6a-2982a228c6b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:44.063624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cd89908b-8ec9-4867-bd6a-2982a228c6b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:44.070255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:44.070871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:44.071885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd89908b-8ec9-4867-bd6a-2982a228c6b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:44.072615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd89908b-8ec9-4867-bd6a-2982a228c6b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:44.073507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd89908b-8ec9-4867-bd6a-2982a228c6b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:44.073966 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd89908b-8ec9-4867-bd6a-2982a228c6b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:44.077724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:44.081567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:44.081567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:44.081567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:44.276002 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd89908b-8ec9-4867-bd6a-2982a228c6b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:44.278261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:44.280632 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:44.284800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cd89908b-8ec9-4867-bd6a-2982a228c6b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.226437 Jul 27 20:23:44.285381 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 522/1044] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:44.289152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:44.290666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:44.291830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bec0ff95-22dd-44d8-b957-cd0c3ae5a769 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.225512 Jul 27 20:23:44.292412 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 523/1045] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:45.307198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-26583cb9-c5ca-4122-ba42-bc782509496b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:45.307787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-26583cb9-c5ca-4122-ba42-bc782509496b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:45.315416 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:45.315887 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26583cb9-c5ca-4122-ba42-bc782509496b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:45.315993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26583cb9-c5ca-4122-ba42-bc782509496b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:45.316105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:45.316705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26583cb9-c5ca-4122-ba42-bc782509496b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:45.317140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26583cb9-c5ca-4122-ba42-bc782509496b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:45.323056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:45.323507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:45.324274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:45.324744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:45.506519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-26583cb9-c5ca-4122-ba42-bc782509496b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:45.513910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-26583cb9-c5ca-4122-ba42-bc782509496b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.210593 Jul 27 20:23:45.514483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 523/1046] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:45.517576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:45.525909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:45.527415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:45.528586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-27aa3ce3-c6c4-4401-905a-45990eb7b39e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.217003 Jul 27 20:23:45.529181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 524/1047] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:45 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:46.534974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-41a5e61e-c76d-4665-a071-9033b9097dec tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:46.535576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-41a5e61e-c76d-4665-a071-9033b9097dec tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:46.541978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-41a5e61e-c76d-4665-a071-9033b9097dec tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:46.542420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-41a5e61e-c76d-4665-a071-9033b9097dec tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:46.543166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-41a5e61e-c76d-4665-a071-9033b9097dec tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:46.543594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-41a5e61e-c76d-4665-a071-9033b9097dec tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:46.550590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:46.551195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:46.557948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:46.558393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:46.559158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:46.559589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:46.742090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-41a5e61e-c76d-4665-a071-9033b9097dec tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:46.749889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:46.750148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-41a5e61e-c76d-4665-a071-9033b9097dec tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.219088 Jul 27 20:23:46.750915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 524/1048] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:46.758587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:46.760079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:46.761242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-03e5f983-76ff-4c8d-ac03-6591775f1fc6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.214495 Jul 27 20:23:46.761794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 525/1049] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:46 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:47.552944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:23:47.553386 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:23:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:23:47.771044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5eda9688-896b-4657-aa86-8a151bda1d30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:47.771659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5eda9688-896b-4657-aa86-8a151bda1d30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:47.778222 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5eda9688-896b-4657-aa86-8a151bda1d30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:47.778797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5eda9688-896b-4657-aa86-8a151bda1d30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:47.780171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5eda9688-896b-4657-aa86-8a151bda1d30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:47.780635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5eda9688-896b-4657-aa86-8a151bda1d30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:47.783442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:47.784054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:47.790474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:47.790923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:47.791680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:47.792110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:47.984304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5eda9688-896b-4657-aa86-8a151bda1d30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:47.987263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:47.992002 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5eda9688-896b-4657-aa86-8a151bda1d30 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.224810 Jul 27 20:23:48.000322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 525/1050] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:47 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:48.001334 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:48.001334 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:48.001334 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dd5106d7-fa42-42c9-a485-abf7f3dffd3a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.219854 Jul 27 20:23:48.001620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 526/1051] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:49.014534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-20c66a72-6d4f-449e-8875-540a54f02c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:49.015135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-20c66a72-6d4f-449e-8875-540a54f02c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:49.021962 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20c66a72-6d4f-449e-8875-540a54f02c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:49.022374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:49.022805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20c66a72-6d4f-449e-8875-540a54f02c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:49.022984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:49.023204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20c66a72-6d4f-449e-8875-540a54f02c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:49.023741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20c66a72-6d4f-449e-8875-540a54f02c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:49.030164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:49.030610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:49.031450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:49.031885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:49.225743 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-20c66a72-6d4f-449e-8875-540a54f02c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:49.229296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:49.233625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-20c66a72-6d4f-449e-8875-540a54f02c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.223554 Jul 27 20:23:49.234197 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 526/1052] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:23:49.237947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:49.239462 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:49.240640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a45564b0-53f0-44b7-8908-8fc85b5194ea tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.222278 Jul 27 20:23:49.241189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 527/1053] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:50.255820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-82ff690c-51fd-4b40-b95f-c1f5e995516e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:50.256361 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-82ff690c-51fd-4b40-b95f-c1f5e995516e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:50.262852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:50.263921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-82ff690c-51fd-4b40-b95f-c1f5e995516e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:50.264104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:50.264358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-82ff690c-51fd-4b40-b95f-c1f5e995516e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:50.265153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-82ff690c-51fd-4b40-b95f-c1f5e995516e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:50.265591 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-82ff690c-51fd-4b40-b95f-c1f5e995516e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:50.270390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:50.270844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:50.271608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:50.272044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:50.462843 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-82ff690c-51fd-4b40-b95f-c1f5e995516e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:50.467364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:50.470551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-82ff690c-51fd-4b40-b95f-c1f5e995516e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.218754 Jul 27 20:23:50.471131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 527/1054] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:50.475674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:50.477315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:50.478532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ee59d2c7-5597-41c8-9421-a4b138d1a328 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.219552 Jul 27 20:23:50.479203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 528/1055] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:50 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:51.492986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4a5a92b0-c639-4bcf-9307-718efa42c1da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:51.493637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4a5a92b0-c639-4bcf-9307-718efa42c1da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:51.500215 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a5a92b0-c639-4bcf-9307-718efa42c1da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:51.500692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a5a92b0-c639-4bcf-9307-718efa42c1da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:51.501456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a5a92b0-c639-4bcf-9307-718efa42c1da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:51.501890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:51.502304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a5a92b0-c639-4bcf-9307-718efa42c1da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:51.502496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:51.508819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:51.509262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:51.510006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:51.510431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:51.696816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4a5a92b0-c639-4bcf-9307-718efa42c1da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:51.699790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:51.705110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4a5a92b0-c639-4bcf-9307-718efa42c1da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.215993 Jul 27 20:23:51.705688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 528/1056] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:51.709144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:51.710644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:51.711823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-70108191-6a07-40af-9c7a-18ae24d55d17 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.213805 Jul 27 20:23:51.712365 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 529/1057] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:52.726494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dabfcff1-cbbe-4026-8e11-ec0651c89045 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:52.727066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dabfcff1-cbbe-4026-8e11-ec0651c89045 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:52.733994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dabfcff1-cbbe-4026-8e11-ec0651c89045 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:52.734413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:52.734831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dabfcff1-cbbe-4026-8e11-ec0651c89045 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:52.735028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:52.735197 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dabfcff1-cbbe-4026-8e11-ec0651c89045 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:52.735634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dabfcff1-cbbe-4026-8e11-ec0651c89045 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:52.741468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:52.741917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:52.742681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:52.743264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:52.930276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dabfcff1-cbbe-4026-8e11-ec0651c89045 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:52.934025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:52.938405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dabfcff1-cbbe-4026-8e11-ec0651c89045 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.215906 Jul 27 20:23:52.938978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 529/1058] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:52.944836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:52.946781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:52.947944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e6bbe019-5b3d-455a-88bf-7eaccb3d8065 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.217814 Jul 27 20:23:52.948531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 530/1059] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:52 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:53.960719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2843c818-26cd-4c3b-9170-fbec5e856791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:53.961391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2843c818-26cd-4c3b-9170-fbec5e856791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:53.968677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2843c818-26cd-4c3b-9170-fbec5e856791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:53.969124 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2843c818-26cd-4c3b-9170-fbec5e856791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:53.969936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2843c818-26cd-4c3b-9170-fbec5e856791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:53.970363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2843c818-26cd-4c3b-9170-fbec5e856791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:53.971305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:53.971914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:53.978829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:53.979297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:53.980009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:53.980461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:54.169681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2843c818-26cd-4c3b-9170-fbec5e856791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:54.172125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:54.177588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2843c818-26cd-4c3b-9170-fbec5e856791 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.220846 Jul 27 20:23:54.178202 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 530/1060] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:54.180863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:54.182505 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:54.183838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-55191d3e-cb38-48ec-8033-2ca495ea7a68 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.216267 Jul 27 20:23:54.184497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 531/1061] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:53 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:55.199063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4bfc8a7b-f5dc-4273-9f49-7539f10fbb26 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:55.199671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4bfc8a7b-f5dc-4273-9f49-7539f10fbb26 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:55.206944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bfc8a7b-f5dc-4273-9f49-7539f10fbb26 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:55.207391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bfc8a7b-f5dc-4273-9f49-7539f10fbb26 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:55.207538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:55.208128 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:55.208253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bfc8a7b-f5dc-4273-9f49-7539f10fbb26 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:55.208597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bfc8a7b-f5dc-4273-9f49-7539f10fbb26 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:55.214360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:55.215622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:55.215622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:55.216097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:55.398751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4bfc8a7b-f5dc-4273-9f49-7539f10fbb26 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:55.405439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:55.406468 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4bfc8a7b-f5dc-4273-9f49-7539f10fbb26 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.211372 Jul 27 20:23:55.407302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 531/1062] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:55.414117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:55.415637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:55.416826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9b956c7a-843f-4c1d-8db9-bf4ad6bfd0d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.213395 Jul 27 20:23:55.417378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 532/1063] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:55 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:56.427244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b9e52ea3-ab30-4f6a-87de-05ff936e8e3f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:56.427861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b9e52ea3-ab30-4f6a-87de-05ff936e8e3f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:56.434377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9e52ea3-ab30-4f6a-87de-05ff936e8e3f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:56.434831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9e52ea3-ab30-4f6a-87de-05ff936e8e3f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:56.435596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9e52ea3-ab30-4f6a-87de-05ff936e8e3f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:56.436035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9e52ea3-ab30-4f6a-87de-05ff936e8e3f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:56.438819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:56.439430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:56.445512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:56.445957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:56.446712 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:56.447142 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:56.632127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b9e52ea3-ab30-4f6a-87de-05ff936e8e3f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:56.635848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:56.640106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b9e52ea3-ab30-4f6a-87de-05ff936e8e3f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.216761 Jul 27 20:23:56.640756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 532/1064] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:56.644890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:56.646403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:56.647555 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-01332f0a-ec96-47ec-b9ee-de775d8dcfe0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.212585 Jul 27 20:23:56.648108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 533/1065] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:57.661392 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-75311a8f-8bdb-4b4b-98bb-53d58bc65aba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:57.661917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-75311a8f-8bdb-4b4b-98bb-53d58bc65aba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:57.664250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=50 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:57.668998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75311a8f-8bdb-4b4b-98bb-53d58bc65aba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:57.669448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75311a8f-8bdb-4b4b-98bb-53d58bc65aba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:57.670846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75311a8f-8bdb-4b4b-98bb-53d58bc65aba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:57.671126 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:57.671565 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75311a8f-8bdb-4b4b-98bb-53d58bc65aba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:57.671741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:57.678134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:57.678587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:57.679409 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:57.679848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:57.867602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:57.871153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-75311a8f-8bdb-4b4b-98bb-53d58bc65aba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:57.876549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:57.878048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:57.879133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-75311a8f-8bdb-4b4b-98bb-53d58bc65aba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.221631 Jul 27 20:23:57.879261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d8a59e53-74d8-4dc3-afe3-1c6729564a63 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.212519 Jul 27 20:23:57.879716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 533/1066] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:57.880014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 534/1067] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:23:58.900408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f94162a8-a014-4e99-8d77-6767f9a68046 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:58.901034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f94162a8-a014-4e99-8d77-6767f9a68046 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:58.901546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:58.902183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:58.904445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=50 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:58.908010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f94162a8-a014-4e99-8d77-6767f9a68046 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:58.908512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f94162a8-a014-4e99-8d77-6767f9a68046 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:58.909268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f94162a8-a014-4e99-8d77-6767f9a68046 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:58.909715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f94162a8-a014-4e99-8d77-6767f9a68046 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:58.910575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:58.911299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:58.912061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:58.912520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:59.105814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f94162a8-a014-4e99-8d77-6767f9a68046 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:59.109621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:59.114232 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f94162a8-a014-4e99-8d77-6767f9a68046 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.217817 Jul 27 20:23:59.114808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 534/1068] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:59.118874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:59.121574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:59.122784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1320ba20-f671-4e0b-ab14-2e46ba009523 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.225075 Jul 27 20:23:59.123324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 535/1069] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:23:58 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:00.135326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c913dae3-383a-4ed3-bbc9-2177cb16d39c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:00.135937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c913dae3-383a-4ed3-bbc9-2177cb16d39c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:00.143134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c913dae3-383a-4ed3-bbc9-2177cb16d39c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:00.143589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c913dae3-383a-4ed3-bbc9-2177cb16d39c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:00.144336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c913dae3-383a-4ed3-bbc9-2177cb16d39c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:00.144796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c913dae3-383a-4ed3-bbc9-2177cb16d39c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:00.145570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:00.146172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:00.152568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:00.152996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:00.153779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:00.154261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:00.340032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c913dae3-383a-4ed3-bbc9-2177cb16d39c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:00.343570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:00.347090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:00.347952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c913dae3-383a-4ed3-bbc9-2177cb16d39c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.216480 Jul 27 20:24:00.348560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 535/1070] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:00.352754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:00.354428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:00.355899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0d0caaa6-930d-4bba-ba48-9c244be59a5c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.213958 Jul 27 20:24:00.356466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 536/1071] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:00 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:01.370172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b2807f43-7a01-4433-b2d8-8bde3278d961 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:01.370766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b2807f43-7a01-4433-b2d8-8bde3278d961 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:01.377338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2807f43-7a01-4433-b2d8-8bde3278d961 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:01.377780 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2807f43-7a01-4433-b2d8-8bde3278d961 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:01.378533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2807f43-7a01-4433-b2d8-8bde3278d961 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:01.378871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:01.379310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2807f43-7a01-4433-b2d8-8bde3278d961 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:01.379485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:01.386273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:01.386721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:01.387474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:01.387909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:01.574583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b2807f43-7a01-4433-b2d8-8bde3278d961 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:01.577634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:01.582283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b2807f43-7a01-4433-b2d8-8bde3278d961 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.215917 Jul 27 20:24:01.582985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 536/1072] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:01 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:01.586629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:01.588132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:01.589402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3dbd2cec-2f5e-4748-813a-d70261f81b40 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.214321 Jul 27 20:24:01.589953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 537/1073] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:02.603942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-77ea65fa-0192-4043-97ec-0b826dc44843 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:02.604716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-77ea65fa-0192-4043-97ec-0b826dc44843 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:02.612841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:02.613483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:02.614880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77ea65fa-0192-4043-97ec-0b826dc44843 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:02.615328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77ea65fa-0192-4043-97ec-0b826dc44843 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:02.616089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77ea65fa-0192-4043-97ec-0b826dc44843 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:02.616754 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77ea65fa-0192-4043-97ec-0b826dc44843 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:02.620093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:02.620600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:02.621378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:02.621815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:02.811163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-77ea65fa-0192-4043-97ec-0b826dc44843 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:02.818006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:02.818761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-77ea65fa-0192-4043-97ec-0b826dc44843 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.218777 Jul 27 20:24:02.819343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 537/1074] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:02 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:02.826594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:02.828107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:02.829278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ab6498d1-b365-46a5-8e13-138eefaf677b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.220350 Jul 27 20:24:02.829833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 538/1075] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:02 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:03.839010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-539ebe16-0dbb-47f6-93e5-51b7a9e14f2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:03.839612 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-539ebe16-0dbb-47f6-93e5-51b7a9e14f2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:03.846149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-539ebe16-0dbb-47f6-93e5-51b7a9e14f2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:03.846595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-539ebe16-0dbb-47f6-93e5-51b7a9e14f2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:03.847343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-539ebe16-0dbb-47f6-93e5-51b7a9e14f2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:03.847766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-539ebe16-0dbb-47f6-93e5-51b7a9e14f2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:03.852199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:03.852877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:03.860715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:03.861173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:03.862062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:03.862499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:04.266207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-539ebe16-0dbb-47f6-93e5-51b7a9e14f2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:04.272641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-539ebe16-0dbb-47f6-93e5-51b7a9e14f2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.437417 Jul 27 20:24:04.273213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 538/1076] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:04.287725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:04.295978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:04.297535 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:04.298671 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6479933d-fd62-4f71-819c-d49b0da338e7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.450495 Jul 27 20:24:04.299226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 539/1077] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:05.295483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e09a6442-8c82-41ba-97ac-b2506d66443e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:05.296096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e09a6442-8c82-41ba-97ac-b2506d66443e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:05.302765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e09a6442-8c82-41ba-97ac-b2506d66443e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:05.303207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e09a6442-8c82-41ba-97ac-b2506d66443e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:05.303991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e09a6442-8c82-41ba-97ac-b2506d66443e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:05.304450 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e09a6442-8c82-41ba-97ac-b2506d66443e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:05.318953 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:05.321871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:05.322491 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:05.329122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:05.329626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:05.330395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:05.330831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:05.504850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e09a6442-8c82-41ba-97ac-b2506d66443e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:05.512257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e09a6442-8c82-41ba-97ac-b2506d66443e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.221350 Jul 27 20:24:05.512856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 539/1078] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:05.516821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:05.525193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:05.526781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:05.527965 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-211cb6db-f459-45da-bcc3-a07b6ae5dfc7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.209974 Jul 27 20:24:05.528579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 540/1079] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:05 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:06.534672 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e585c13b-1b12-465b-b16e-1d109bed5ffb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:06.535285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e585c13b-1b12-465b-b16e-1d109bed5ffb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:06.541798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e585c13b-1b12-465b-b16e-1d109bed5ffb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:06.542255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e585c13b-1b12-465b-b16e-1d109bed5ffb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:06.543013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e585c13b-1b12-465b-b16e-1d109bed5ffb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:06.543450 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e585c13b-1b12-465b-b16e-1d109bed5ffb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:06.551527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:06.552184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:06.558601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:06.559049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:06.559804 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:06.560253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:06.738885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e585c13b-1b12-465b-b16e-1d109bed5ffb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:06.742618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:06.746416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e585c13b-1b12-465b-b16e-1d109bed5ffb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.215646 Jul 27 20:24:06.747193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 540/1080] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:06.751046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:06.752569 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:06.753829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7ea6b72a-4267-498e-9499-cb5376b15bbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.206210 Jul 27 20:24:06.754417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 541/1081] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:06 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:07.767610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d5d2eb81-036d-412a-8a11-545596d8b616 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:07.768216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d5d2eb81-036d-412a-8a11-545596d8b616 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:07.774749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5d2eb81-036d-412a-8a11-545596d8b616 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:07.775196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5d2eb81-036d-412a-8a11-545596d8b616 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:07.775975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5d2eb81-036d-412a-8a11-545596d8b616 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:07.776076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:07.776705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5d2eb81-036d-412a-8a11-545596d8b616 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:07.776836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:07.783309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:07.783764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:07.784563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:07.785000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:07.969776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d5d2eb81-036d-412a-8a11-545596d8b616 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:07.973650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:07.977650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d5d2eb81-036d-412a-8a11-545596d8b616 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.213886 Jul 27 20:24:07.978303 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 541/1082] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:07.982721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:07.984236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:07.985433 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-98c50daf-f315-40de-82a6-c09923972235 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.213155 Jul 27 20:24:07.986000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 542/1083] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:07 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:08.999511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2dfc92d2-ceb3-4dcb-8e07-9e4b70ffd3b5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:09.000140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2dfc92d2-ceb3-4dcb-8e07-9e4b70ffd3b5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:09.006841 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2dfc92d2-ceb3-4dcb-8e07-9e4b70ffd3b5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:09.007299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2dfc92d2-ceb3-4dcb-8e07-9e4b70ffd3b5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:09.008062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2dfc92d2-ceb3-4dcb-8e07-9e4b70ffd3b5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:09.008528 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2dfc92d2-ceb3-4dcb-8e07-9e4b70ffd3b5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:09.010382 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:09.010982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:09.018293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:09.018740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:09.019498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:09.019930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:09.197061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2dfc92d2-ceb3-4dcb-8e07-9e4b70ffd3b5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:09.201006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:09.204673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2dfc92d2-ceb3-4dcb-8e07-9e4b70ffd3b5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.209606 Jul 27 20:24:09.205253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 542/1084] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:08 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:09.209328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:09.210846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:09.212022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7bf227bb-58eb-46c4-b483-f3bf9c586ea5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.205584 Jul 27 20:24:09.212607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 543/1085] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:10.225703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-335590b6-5b9e-4cac-b2dd-48a51a81730b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:10.226316 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-335590b6-5b9e-4cac-b2dd-48a51a81730b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:10.233818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-335590b6-5b9e-4cac-b2dd-48a51a81730b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:10.234187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:10.234598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-335590b6-5b9e-4cac-b2dd-48a51a81730b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:10.234803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:10.235021 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-335590b6-5b9e-4cac-b2dd-48a51a81730b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:10.235459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-335590b6-5b9e-4cac-b2dd-48a51a81730b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:10.241411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:10.241863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:10.242619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:10.243051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:10.432295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-335590b6-5b9e-4cac-b2dd-48a51a81730b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:10.436229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:10.439969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-335590b6-5b9e-4cac-b2dd-48a51a81730b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.218200 Jul 27 20:24:10.440577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 543/1086] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:10.444647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:10.446166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:10.447324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c480b9d9-c187-4c40-807c-cff50f7c0e38 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.217698 Jul 27 20:24:10.447876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 544/1087] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:11.462064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a225eafa-b8f1-4cb3-a70b-a8ed47e4b4d7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:11.462605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a225eafa-b8f1-4cb3-a70b-a8ed47e4b4d7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:11.469105 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a225eafa-b8f1-4cb3-a70b-a8ed47e4b4d7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:11.469546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a225eafa-b8f1-4cb3-a70b-a8ed47e4b4d7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:11.469816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:11.470285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a225eafa-b8f1-4cb3-a70b-a8ed47e4b4d7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:11.470419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:11.470711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a225eafa-b8f1-4cb3-a70b-a8ed47e4b4d7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:11.476738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:11.477178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:11.477919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:11.478345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:11.665519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a225eafa-b8f1-4cb3-a70b-a8ed47e4b4d7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:11.672670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:11.673453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a225eafa-b8f1-4cb3-a70b-a8ed47e4b4d7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.215259 Jul 27 20:24:11.674025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 544/1088] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:11.681197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:11.682694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:11.683832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-53ada993-a7f4-4f83-bf83-62ae20bf937e tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.217805 Jul 27 20:24:11.684375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 545/1089] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:11 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:12.695224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2a9846c8-3e8b-4e91-bf9f-641484aa589b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:12.695762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2a9846c8-3e8b-4e91-bf9f-641484aa589b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:12.702824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a9846c8-3e8b-4e91-bf9f-641484aa589b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:12.703270 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a9846c8-3e8b-4e91-bf9f-641484aa589b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:12.704027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a9846c8-3e8b-4e91-bf9f-641484aa589b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:12.704482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a9846c8-3e8b-4e91-bf9f-641484aa589b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:12.707335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:12.707997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:12.714394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:12.714837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:12.715590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:12.716014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:12.900360 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2a9846c8-3e8b-4e91-bf9f-641484aa589b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:12.907149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:12.907896 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2a9846c8-3e8b-4e91-bf9f-641484aa589b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.216604 Jul 27 20:24:12.908577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 545/1090] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:12.915510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:12.917029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:12.918167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-55e3839d-99a3-4bf7-833a-fae10019b166 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.214843 Jul 27 20:24:12.919420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 546/1091] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:12 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:13.929819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d059e879-24ad-4748-95e0-6cb6ed803c45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:13.930595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d059e879-24ad-4748-95e0-6cb6ed803c45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:13.936606 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d059e879-24ad-4748-95e0-6cb6ed803c45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:13.937061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d059e879-24ad-4748-95e0-6cb6ed803c45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:13.937824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d059e879-24ad-4748-95e0-6cb6ed803c45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:13.938262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d059e879-24ad-4748-95e0-6cb6ed803c45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:13.940572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:13.941180 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:13.947522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:13.947980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:13.948839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:13.949269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:14.140084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d059e879-24ad-4748-95e0-6cb6ed803c45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:14.144124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:14.147828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d059e879-24ad-4748-95e0-6cb6ed803c45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.222152 Jul 27 20:24:14.148498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 546/1092] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:14.152563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:14.154070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:14.155245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-816886ed-ca70-4d1a-808e-2863cf8b2d57 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.218526 Jul 27 20:24:14.155799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 547/1093] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:13 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:24:15.169613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-57587bd7-7339-4ee6-a615-4b62f5a9653a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:15.170220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-57587bd7-7339-4ee6-a615-4b62f5a9653a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:15.176443 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57587bd7-7339-4ee6-a615-4b62f5a9653a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:15.176895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57587bd7-7339-4ee6-a615-4b62f5a9653a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:15.177652 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57587bd7-7339-4ee6-a615-4b62f5a9653a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:15.177768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:15.178173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57587bd7-7339-4ee6-a615-4b62f5a9653a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:15.178286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:15.185300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:15.185751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:15.186514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:15.186974 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:15.376211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-57587bd7-7339-4ee6-a615-4b62f5a9653a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:15.380259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:15.383834 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-57587bd7-7339-4ee6-a615-4b62f5a9653a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.218690 Jul 27 20:24:15.384422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 547/1094] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:15 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:15.389383 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:15.390904 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:15.392059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-220c13bd-52fb-43b9-909e-c2e2fd5efef2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.218213 Jul 27 20:24:15.392654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 548/1095] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:16.405225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-786b5cf8-5b5b-40c7-9dfc-bec571e17f57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:16.405875 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-786b5cf8-5b5b-40c7-9dfc-bec571e17f57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:16.412490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-786b5cf8-5b5b-40c7-9dfc-bec571e17f57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:16.412947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-786b5cf8-5b5b-40c7-9dfc-bec571e17f57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:16.413715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-786b5cf8-5b5b-40c7-9dfc-bec571e17f57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:16.414153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-786b5cf8-5b5b-40c7-9dfc-bec571e17f57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:16.414874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:16.415484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:16.421892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:16.422335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:16.423085 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:16.423514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:16.609299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-786b5cf8-5b5b-40c7-9dfc-bec571e17f57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:16.613344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:16.616800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-786b5cf8-5b5b-40c7-9dfc-bec571e17f57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.215372 Jul 27 20:24:16.617372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 548/1096] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:16.622220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:16.623823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:16.625033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-098a15dc-22e3-4a4a-85f5-5dea2c9740ab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.214069 Jul 27 20:24:16.625587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 549/1097] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:16 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:17.640861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-99805376-405b-4553-bf9d-3a65aaff6432 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:17.641540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-99805376-405b-4553-bf9d-3a65aaff6432 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:17.648284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:17.648882 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99805376-405b-4553-bf9d-3a65aaff6432 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:17.649042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:17.649674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99805376-405b-4553-bf9d-3a65aaff6432 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:17.650441 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99805376-405b-4553-bf9d-3a65aaff6432 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:17.650868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99805376-405b-4553-bf9d-3a65aaff6432 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:17.656778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:17.657464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:17.658230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:17.658664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:17.854522 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-99805376-405b-4553-bf9d-3a65aaff6432 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:17.860471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-99805376-405b-4553-bf9d-3a65aaff6432 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.226040 Jul 27 20:24:17.861489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 549/1098] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:17.866457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:17.867889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3fe95f69-c0ea-48fc-a11b-35d03a02936d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:17.868415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3fe95f69-c0ea-48fc-a11b-35d03a02936d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:17.874808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3fe95f69-c0ea-48fc-a11b-35d03a02936d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:17.875258 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3fe95f69-c0ea-48fc-a11b-35d03a02936d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:17.875383 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:17.876018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3fe95f69-c0ea-48fc-a11b-35d03a02936d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:17.876593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3fe95f69-c0ea-48fc-a11b-35d03a02936d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:17.876832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:17.877982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-77d11f0e-6105-4af6-b66e-9288015fd501 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.233571 Jul 27 20:24:17.878533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 550/1099] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:18.900969 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8f84933c-b446-4a95-9e35-9e681397fa55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:18.902271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8f84933c-b446-4a95-9e35-9e681397fa55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:18.910581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f84933c-b446-4a95-9e35-9e681397fa55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:18.911320 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f84933c-b446-4a95-9e35-9e681397fa55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:18.912124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f84933c-b446-4a95-9e35-9e681397fa55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:18.912583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f84933c-b446-4a95-9e35-9e681397fa55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:19.045101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8f84933c-b446-4a95-9e35-9e681397fa55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:19.052542 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8f84933c-b446-4a95-9e35-9e681397fa55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.155384 Jul 27 20:24:19.053102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 551/1100] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:19.057462 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:19.058059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:19.063625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:19.064065 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:19.064849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:19.065284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:19.195373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:19.204335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:19.205863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:19.207013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-243357cd-5e8b-4998-a46f-c3cef3ef831b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153021 Jul 27 20:24:19.207568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 552/1101] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:19 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:24:19.211836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e23d4e5c-e0cb-4267-b4ee-88917805252e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:19.212319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e23d4e5c-e0cb-4267-b4ee-88917805252e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:19.218423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e23d4e5c-e0cb-4267-b4ee-88917805252e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:19.218866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e23d4e5c-e0cb-4267-b4ee-88917805252e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:19.219617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e23d4e5c-e0cb-4267-b4ee-88917805252e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:19.220046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e23d4e5c-e0cb-4267-b4ee-88917805252e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:19.237455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:19.244322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e23d4e5c-e0cb-4267-b4ee-88917805252e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:24:19.481749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e23d4e5c-e0cb-4267-b4ee-88917805252e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "DELETE /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 204 len: 0 microversion: 2.1 time: 0.272935 Jul 27 20:24:19.482339 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 553/1102] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:24:19 2022] DELETE /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:24:19.490523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-13d378c0-3839-474d-81da-7b02970d553b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:19.491216 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-13d378c0-3839-474d-81da-7b02970d553b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:19.497744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13d378c0-3839-474d-81da-7b02970d553b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:19.498395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13d378c0-3839-474d-81da-7b02970d553b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:19.498946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13d378c0-3839-474d-81da-7b02970d553b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:19.499371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13d378c0-3839-474d-81da-7b02970d553b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:19.626435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-13d378c0-3839-474d-81da-7b02970d553b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:19.634288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-13d378c0-3839-474d-81da-7b02970d553b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.147691 Jul 27 20:24:19.635072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 554/1103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:19 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:20.074195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ef9f33e3-93f2-41ae-811e-d1fdbfc3ecf1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:20.075493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ef9f33e3-93f2-41ae-811e-d1fdbfc3ecf1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:20.082443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef9f33e3-93f2-41ae-811e-d1fdbfc3ecf1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:20.082895 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef9f33e3-93f2-41ae-811e-d1fdbfc3ecf1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:20.083653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef9f33e3-93f2-41ae-811e-d1fdbfc3ecf1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:20.084087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef9f33e3-93f2-41ae-811e-d1fdbfc3ecf1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:20.210818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ef9f33e3-93f2-41ae-811e-d1fdbfc3ecf1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:20.218323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ef9f33e3-93f2-41ae-811e-d1fdbfc3ecf1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.148019 Jul 27 20:24:20.218892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 555/1104] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:20.229686 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:20.230544 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:20.236262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:20.236741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:20.237494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:20.237923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:20.374725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:20.383017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:20.384550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:20.385689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c04012f9-c3d6-41b4-abd2-25a4f87b82da tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.159566 Jul 27 20:24:20.386247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 556/1105] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:20 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:20.656102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8439224b-c5a0-4832-bf51-ba808ebb6445 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:20.656673 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8439224b-c5a0-4832-bf51-ba808ebb6445 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:20.662744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8439224b-c5a0-4832-bf51-ba808ebb6445 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:20.663198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8439224b-c5a0-4832-bf51-ba808ebb6445 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:20.663955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8439224b-c5a0-4832-bf51-ba808ebb6445 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:20.664412 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8439224b-c5a0-4832-bf51-ba808ebb6445 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:20.788496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8439224b-c5a0-4832-bf51-ba808ebb6445 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:20.796958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8439224b-c5a0-4832-bf51-ba808ebb6445 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.144809 Jul 27 20:24:20.797530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 557/1106] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:20 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:21.240536 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-587f534c-521a-47f3-be4b-004cb17ef2eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:21.241173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-587f534c-521a-47f3-be4b-004cb17ef2eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:21.248289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-587f534c-521a-47f3-be4b-004cb17ef2eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:21.248865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-587f534c-521a-47f3-be4b-004cb17ef2eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:21.249624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-587f534c-521a-47f3-be4b-004cb17ef2eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:21.250051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-587f534c-521a-47f3-be4b-004cb17ef2eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:21.383772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-587f534c-521a-47f3-be4b-004cb17ef2eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:21.391343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-587f534c-521a-47f3-be4b-004cb17ef2eb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.154752 Jul 27 20:24:21.391919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 558/1107] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:21.408631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:21.409244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:21.414935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:21.415384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:21.416141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:21.416616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:21.542059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:21.551122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:21.552665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:21.553823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0af45855-8467-402b-bc9a-408d14ed3104 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.148827 Jul 27 20:24:21.554384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 559/1108] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:21.817355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2bbe6868-023a-4402-ba69-9069b142dded tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:21.817880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2bbe6868-023a-4402-ba69-9069b142dded tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:21.823798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bbe6868-023a-4402-ba69-9069b142dded tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:21.824236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bbe6868-023a-4402-ba69-9069b142dded tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:21.825080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bbe6868-023a-4402-ba69-9069b142dded tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:21.825506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bbe6868-023a-4402-ba69-9069b142dded tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:21.953754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2bbe6868-023a-4402-ba69-9069b142dded tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:21.961545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2bbe6868-023a-4402-ba69-9069b142dded tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.148001 Jul 27 20:24:21.962107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 560/1109] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:21 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:22.412286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6ca1811d-540b-4dc4-b704-6e9c995f2e07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:22.412946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6ca1811d-540b-4dc4-b704-6e9c995f2e07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:22.419955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ca1811d-540b-4dc4-b704-6e9c995f2e07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:22.420420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ca1811d-540b-4dc4-b704-6e9c995f2e07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:22.421207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ca1811d-540b-4dc4-b704-6e9c995f2e07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:22.421636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ca1811d-540b-4dc4-b704-6e9c995f2e07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:22.548272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6ca1811d-540b-4dc4-b704-6e9c995f2e07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:22.555758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6ca1811d-540b-4dc4-b704-6e9c995f2e07 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147346 Jul 27 20:24:22.556357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 561/1110] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:22.576041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:22.576714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:22.582429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:22.582876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:22.583640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:22.584072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:22.710287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:22.719378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:22.720932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:22.722096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf10a299-e745-488f-b22c-1a0257ead939 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.149760 Jul 27 20:24:22.722666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 562/1111] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:22.982468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-db6d5d6b-9396-4aa4-93fc-62e0dc222272 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:22.983129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-db6d5d6b-9396-4aa4-93fc-62e0dc222272 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:22.989112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db6d5d6b-9396-4aa4-93fc-62e0dc222272 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:22.991694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db6d5d6b-9396-4aa4-93fc-62e0dc222272 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:22.991694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db6d5d6b-9396-4aa4-93fc-62e0dc222272 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:22.991694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db6d5d6b-9396-4aa4-93fc-62e0dc222272 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:23.123781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-db6d5d6b-9396-4aa4-93fc-62e0dc222272 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:23.131834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-db6d5d6b-9396-4aa4-93fc-62e0dc222272 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.153523 Jul 27 20:24:23.132574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 563/1112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:22 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:23.577158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-127f9897-3e02-4a01-937f-0761aafdb1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:23.605331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-127f9897-3e02-4a01-937f-0761aafdb1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:23.605331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-127f9897-3e02-4a01-937f-0761aafdb1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:23.605331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-127f9897-3e02-4a01-937f-0761aafdb1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:23.605331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-127f9897-3e02-4a01-937f-0761aafdb1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:23.606235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-127f9897-3e02-4a01-937f-0761aafdb1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:23.721956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-127f9897-3e02-4a01-937f-0761aafdb1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:23.729414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-127f9897-3e02-4a01-937f-0761aafdb1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.156125 Jul 27 20:24:23.730257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 564/1113] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:23.745188 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:23.745798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:23.752263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:23.752750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:23.753548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:23.753985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:23.883673 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:23.892088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:23.893661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:23.894811 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ecbaa59-e862-4193-ae04-601d7b90b5bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 200 len: 1752 microversion: 2.20 time: 0.153486 Jul 27 20:24:23.895368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 565/1114] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:24:23 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:24:24.154830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-09af61b6-6fb9-4bca-acc0-f23b949e7953 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:24.155363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-09af61b6-6fb9-4bca-acc0-f23b949e7953 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:24.161541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09af61b6-6fb9-4bca-acc0-f23b949e7953 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:24.161992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09af61b6-6fb9-4bca-acc0-f23b949e7953 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:24.162806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09af61b6-6fb9-4bca-acc0-f23b949e7953 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:24.163248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09af61b6-6fb9-4bca-acc0-f23b949e7953 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:24.290467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-09af61b6-6fb9-4bca-acc0-f23b949e7953 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:24.298317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-09af61b6-6fb9-4bca-acc0-f23b949e7953 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.147927 Jul 27 20:24:24.298894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 566/1115] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:24 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:24.751267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ec6e2ad8-96ce-4092-ac81-c3b67c43e5af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:24.751923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ec6e2ad8-96ce-4092-ac81-c3b67c43e5af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:24.758431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ec6e2ad8-96ce-4092-ac81-c3b67c43e5af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:24.758883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ec6e2ad8-96ce-4092-ac81-c3b67c43e5af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:24.759639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ec6e2ad8-96ce-4092-ac81-c3b67c43e5af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:24.760073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ec6e2ad8-96ce-4092-ac81-c3b67c43e5af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:24.887014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ec6e2ad8-96ce-4092-ac81-c3b67c43e5af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:24.894446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ec6e2ad8-96ce-4092-ac81-c3b67c43e5af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.147071 Jul 27 20:24:24.895019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 567/1116] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:25.319249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c82a66ae-25ff-4828-83bd-5ee986078266 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:25.319859 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c82a66ae-25ff-4828-83bd-5ee986078266 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:25.326560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82a66ae-25ff-4828-83bd-5ee986078266 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:25.327049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82a66ae-25ff-4828-83bd-5ee986078266 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:25.327808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82a66ae-25ff-4828-83bd-5ee986078266 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:25.328238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82a66ae-25ff-4828-83bd-5ee986078266 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:25.346938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:25.458954 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c82a66ae-25ff-4828-83bd-5ee986078266 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:25.466818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c82a66ae-25ff-4828-83bd-5ee986078266 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.151650 Jul 27 20:24:25.467392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 568/1117] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:25 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:25.916270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-acff0d4e-bd8d-43ed-bdc0-94a1dc9cb421 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:25.916953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-acff0d4e-bd8d-43ed-bdc0-94a1dc9cb421 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:25.923287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-acff0d4e-bd8d-43ed-bdc0-94a1dc9cb421 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:25.923724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-acff0d4e-bd8d-43ed-bdc0-94a1dc9cb421 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:25.924492 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-acff0d4e-bd8d-43ed-bdc0-94a1dc9cb421 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:25.924918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-acff0d4e-bd8d-43ed-bdc0-94a1dc9cb421 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:26.051718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-acff0d4e-bd8d-43ed-bdc0-94a1dc9cb421 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:26.059113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-acff0d4e-bd8d-43ed-bdc0-94a1dc9cb421 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.146748 Jul 27 20:24:26.060166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 569/1118] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:26.488672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5de4b2ba-601b-476d-a004-05e56dadff18 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:26.489269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5de4b2ba-601b-476d-a004-05e56dadff18 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:26.495631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de4b2ba-601b-476d-a004-05e56dadff18 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:26.496067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de4b2ba-601b-476d-a004-05e56dadff18 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:26.496847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de4b2ba-601b-476d-a004-05e56dadff18 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:26.497921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de4b2ba-601b-476d-a004-05e56dadff18 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:26.628899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5de4b2ba-601b-476d-a004-05e56dadff18 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:26.636725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5de4b2ba-601b-476d-a004-05e56dadff18 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.152036 Jul 27 20:24:26.637286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 570/1119] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:26 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:27.080897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d5d6ac92-c218-44ca-8bd6-26cbb0f66df7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:27.081559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d5d6ac92-c218-44ca-8bd6-26cbb0f66df7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:27.087375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5d6ac92-c218-44ca-8bd6-26cbb0f66df7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:27.087813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5d6ac92-c218-44ca-8bd6-26cbb0f66df7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:27.088594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5d6ac92-c218-44ca-8bd6-26cbb0f66df7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:27.089024 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5d6ac92-c218-44ca-8bd6-26cbb0f66df7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:27.218704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d5d6ac92-c218-44ca-8bd6-26cbb0f66df7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:27.226104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d5d6ac92-c218-44ca-8bd6-26cbb0f66df7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.149212 Jul 27 20:24:27.226664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 571/1120] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:27 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:27.658052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-32c8daf4-2ec9-4460-9af9-6db4c7666261 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:27.658574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-32c8daf4-2ec9-4460-9af9-6db4c7666261 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:27.664940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32c8daf4-2ec9-4460-9af9-6db4c7666261 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:27.665378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32c8daf4-2ec9-4460-9af9-6db4c7666261 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:27.666124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32c8daf4-2ec9-4460-9af9-6db4c7666261 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:27.666549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32c8daf4-2ec9-4460-9af9-6db4c7666261 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:27.800594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-32c8daf4-2ec9-4460-9af9-6db4c7666261 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:27.808495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-32c8daf4-2ec9-4460-9af9-6db4c7666261 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.154304 Jul 27 20:24:27.809066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 572/1121] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:27 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:27.871796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=35 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:27.936677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=67 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:28.247154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e9de0dc1-ed81-45ee-a2d6-1f028c2f1af6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:28.247799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e9de0dc1-ed81-45ee-a2d6-1f028c2f1af6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:28.253870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9de0dc1-ed81-45ee-a2d6-1f028c2f1af6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:28.254378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9de0dc1-ed81-45ee-a2d6-1f028c2f1af6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:28.255140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9de0dc1-ed81-45ee-a2d6-1f028c2f1af6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:28.255577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9de0dc1-ed81-45ee-a2d6-1f028c2f1af6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:28.386656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e9de0dc1-ed81-45ee-a2d6-1f028c2f1af6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:28.394805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e9de0dc1-ed81-45ee-a2d6-1f028c2f1af6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151574 Jul 27 20:24:28.395376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 573/1122] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:28.829256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-58b83020-04af-4c35-b30c-7fd0893ac4e4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:28.829865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-58b83020-04af-4c35-b30c-7fd0893ac4e4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:28.836344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58b83020-04af-4c35-b30c-7fd0893ac4e4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:28.836821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58b83020-04af-4c35-b30c-7fd0893ac4e4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:28.837578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58b83020-04af-4c35-b30c-7fd0893ac4e4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:28.838010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58b83020-04af-4c35-b30c-7fd0893ac4e4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:28.963974 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-58b83020-04af-4c35-b30c-7fd0893ac4e4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:28.971894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-58b83020-04af-4c35-b30c-7fd0893ac4e4 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.146533 Jul 27 20:24:28.972483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 574/1123] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:28 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:29.415034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5e127eb8-d673-4163-9d53-c555b4a22028 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:29.415653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5e127eb8-d673-4163-9d53-c555b4a22028 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:29.417596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:29.422967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e127eb8-d673-4163-9d53-c555b4a22028 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:29.423417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e127eb8-d673-4163-9d53-c555b4a22028 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:29.424172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e127eb8-d673-4163-9d53-c555b4a22028 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:29.424626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e127eb8-d673-4163-9d53-c555b4a22028 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:29.634156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5e127eb8-d673-4163-9d53-c555b4a22028 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:29.642199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5e127eb8-d673-4163-9d53-c555b4a22028 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.231013 Jul 27 20:24:29.642773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 575/1124] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:29.992928 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ae8dc102-9f78-43e3-b30e-3a998e6ada7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:29.993537 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ae8dc102-9f78-43e3-b30e-3a998e6ada7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:30.000411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae8dc102-9f78-43e3-b30e-3a998e6ada7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:30.000868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae8dc102-9f78-43e3-b30e-3a998e6ada7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:30.001624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae8dc102-9f78-43e3-b30e-3a998e6ada7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:30.002058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae8dc102-9f78-43e3-b30e-3a998e6ada7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:30.130206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ae8dc102-9f78-43e3-b30e-3a998e6ada7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:30.138720 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ae8dc102-9f78-43e3-b30e-3a998e6ada7e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.149720 Jul 27 20:24:30.139290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 576/1125] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:29 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:30.663804 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b7199471-ff0f-499a-af12-0304e8577e4e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:30.664483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b7199471-ff0f-499a-af12-0304e8577e4e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:30.671060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7199471-ff0f-499a-af12-0304e8577e4e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:30.671500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7199471-ff0f-499a-af12-0304e8577e4e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:30.672253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7199471-ff0f-499a-af12-0304e8577e4e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:30.672728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7199471-ff0f-499a-af12-0304e8577e4e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:30.802829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b7199471-ff0f-499a-af12-0304e8577e4e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:30.810434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b7199471-ff0f-499a-af12-0304e8577e4e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.150536 Jul 27 20:24:30.811008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 577/1126] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:31.159454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-445a8e13-3078-4555-8987-97a628caa8ae tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:31.160056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-445a8e13-3078-4555-8987-97a628caa8ae tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:31.166559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-445a8e13-3078-4555-8987-97a628caa8ae tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:31.167003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-445a8e13-3078-4555-8987-97a628caa8ae tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:31.167744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-445a8e13-3078-4555-8987-97a628caa8ae tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:31.168169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-445a8e13-3078-4555-8987-97a628caa8ae tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:31.293155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-445a8e13-3078-4555-8987-97a628caa8ae tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:31.301072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-445a8e13-3078-4555-8987-97a628caa8ae tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.145437 Jul 27 20:24:31.301642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 578/1127] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:31 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:31.831816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4d957154-d21d-40cf-9412-f08a000c3f51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:31.832424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4d957154-d21d-40cf-9412-f08a000c3f51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:31.838317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d957154-d21d-40cf-9412-f08a000c3f51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:31.838757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d957154-d21d-40cf-9412-f08a000c3f51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:31.839498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d957154-d21d-40cf-9412-f08a000c3f51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:31.839921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d957154-d21d-40cf-9412-f08a000c3f51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:31.980499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4d957154-d21d-40cf-9412-f08a000c3f51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:31.989240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4d957154-d21d-40cf-9412-f08a000c3f51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.161349 Jul 27 20:24:31.989907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 579/1128] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:32.322628 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4113e24e-b1a2-492c-a750-0d4ffaab45ec tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:32.323245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4113e24e-b1a2-492c-a750-0d4ffaab45ec tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:32.330417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4113e24e-b1a2-492c-a750-0d4ffaab45ec tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:32.330871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4113e24e-b1a2-492c-a750-0d4ffaab45ec tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:32.331638 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4113e24e-b1a2-492c-a750-0d4ffaab45ec tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:32.332082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4113e24e-b1a2-492c-a750-0d4ffaab45ec tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:32.459238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4113e24e-b1a2-492c-a750-0d4ffaab45ec tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:32.467076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4113e24e-b1a2-492c-a750-0d4ffaab45ec tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.148372 Jul 27 20:24:32.467646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 580/1129] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:32 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:33.010223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7a5374f9-881c-4fe5-b775-b52dd08ad30f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:33.010898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7a5374f9-881c-4fe5-b775-b52dd08ad30f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:33.017623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7a5374f9-881c-4fe5-b775-b52dd08ad30f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:33.018060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7a5374f9-881c-4fe5-b775-b52dd08ad30f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:33.018810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7a5374f9-881c-4fe5-b775-b52dd08ad30f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:33.019240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7a5374f9-881c-4fe5-b775-b52dd08ad30f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:33.149873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7a5374f9-881c-4fe5-b775-b52dd08ad30f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:33.157355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7a5374f9-881c-4fe5-b775-b52dd08ad30f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151014 Jul 27 20:24:33.157920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 581/1130] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:33 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:33.492065 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1383671e-72f7-4df9-9f66-afc943fff781 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:33.492687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1383671e-72f7-4df9-9f66-afc943fff781 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:33.499699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1383671e-72f7-4df9-9f66-afc943fff781 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:33.500138 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1383671e-72f7-4df9-9f66-afc943fff781 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:33.500908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1383671e-72f7-4df9-9f66-afc943fff781 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:33.501336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1383671e-72f7-4df9-9f66-afc943fff781 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:33.633096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1383671e-72f7-4df9-9f66-afc943fff781 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:33.641162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1383671e-72f7-4df9-9f66-afc943fff781 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.152951 Jul 27 20:24:33.645041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 582/1131] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:33 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:34.179270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-623b931f-ba14-45b0-9a9a-8a9e41feee39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:34.179925 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-623b931f-ba14-45b0-9a9a-8a9e41feee39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:34.185987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-623b931f-ba14-45b0-9a9a-8a9e41feee39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:34.186431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-623b931f-ba14-45b0-9a9a-8a9e41feee39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:34.187205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-623b931f-ba14-45b0-9a9a-8a9e41feee39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:34.187645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-623b931f-ba14-45b0-9a9a-8a9e41feee39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:34.329499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-623b931f-ba14-45b0-9a9a-8a9e41feee39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:34.337206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-623b931f-ba14-45b0-9a9a-8a9e41feee39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.161932 Jul 27 20:24:34.337792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 583/1132] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:34.662955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c7629075-ddfc-4253-9f64-99c78517c114 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:34.663478 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c7629075-ddfc-4253-9f64-99c78517c114 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:34.669934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7629075-ddfc-4253-9f64-99c78517c114 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:34.670376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7629075-ddfc-4253-9f64-99c78517c114 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:34.671119 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7629075-ddfc-4253-9f64-99c78517c114 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:34.671544 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7629075-ddfc-4253-9f64-99c78517c114 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:34.799868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7629075-ddfc-4253-9f64-99c78517c114 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:34.807768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c7629075-ddfc-4253-9f64-99c78517c114 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.148731 Jul 27 20:24:34.808348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 584/1133] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:34 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:35.358866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2ac52a5c-a642-43ea-9c9f-9841636f7bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:35.359471 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2ac52a5c-a642-43ea-9c9f-9841636f7bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:35.365521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ac52a5c-a642-43ea-9c9f-9841636f7bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:35.365961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ac52a5c-a642-43ea-9c9f-9841636f7bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:35.366707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ac52a5c-a642-43ea-9c9f-9841636f7bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:35.367151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ac52a5c-a642-43ea-9c9f-9841636f7bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:35.370975 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:35.498538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ac52a5c-a642-43ea-9c9f-9841636f7bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:35.506002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2ac52a5c-a642-43ea-9c9f-9841636f7bda tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.151399 Jul 27 20:24:35.506579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 585/1134] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:35 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:35.829700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e8164ca-ccf6-4f0b-bb52-1597ac870fb0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:35.830313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7e8164ca-ccf6-4f0b-bb52-1597ac870fb0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:35.837046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e8164ca-ccf6-4f0b-bb52-1597ac870fb0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:35.837500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e8164ca-ccf6-4f0b-bb52-1597ac870fb0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:35.838261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e8164ca-ccf6-4f0b-bb52-1597ac870fb0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:35.838697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e8164ca-ccf6-4f0b-bb52-1597ac870fb0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:35.971141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7e8164ca-ccf6-4f0b-bb52-1597ac870fb0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:35.979032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7e8164ca-ccf6-4f0b-bb52-1597ac870fb0 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.153084 Jul 27 20:24:35.979865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 586/1135] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:35 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:24:36.527076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a2ef42f1-a38f-4459-a302-92e594d30c51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:36.528297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a2ef42f1-a38f-4459-a302-92e594d30c51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:36.534301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2ef42f1-a38f-4459-a302-92e594d30c51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:36.534736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2ef42f1-a38f-4459-a302-92e594d30c51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:36.535474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2ef42f1-a38f-4459-a302-92e594d30c51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:36.535896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2ef42f1-a38f-4459-a302-92e594d30c51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:36.669110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a2ef42f1-a38f-4459-a302-92e594d30c51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:36.676699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a2ef42f1-a38f-4459-a302-92e594d30c51 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.153363 Jul 27 20:24:36.677283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 587/1136] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:37.000727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8992b7c1-847f-4650-a27b-142ee793466b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:37.001332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8992b7c1-847f-4650-a27b-142ee793466b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:37.007694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8992b7c1-847f-4650-a27b-142ee793466b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:37.008142 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8992b7c1-847f-4650-a27b-142ee793466b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:37.008919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8992b7c1-847f-4650-a27b-142ee793466b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:37.009348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8992b7c1-847f-4650-a27b-142ee793466b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:37.133929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8992b7c1-847f-4650-a27b-142ee793466b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:37.141870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8992b7c1-847f-4650-a27b-142ee793466b tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.145671 Jul 27 20:24:37.142432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 588/1137] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:36 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:37.697970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a8fa754b-4953-4687-8082-b8b1fe254bac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:37.698580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a8fa754b-4953-4687-8082-b8b1fe254bac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:37.705075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8fa754b-4953-4687-8082-b8b1fe254bac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:37.705526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8fa754b-4953-4687-8082-b8b1fe254bac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:37.706282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8fa754b-4953-4687-8082-b8b1fe254bac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:37.706714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8fa754b-4953-4687-8082-b8b1fe254bac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:37.843617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a8fa754b-4953-4687-8082-b8b1fe254bac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:24:37.852147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a8fa754b-4953-4687-8082-b8b1fe254bac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.158085 Jul 27 20:24:37.852745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 589/1138] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:24:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:24:37.857543 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2418ec99-fa82-4c97-a767-6cd91a014522 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:37.859790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2418ec99-fa82-4c97-a767-6cd91a014522 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:37.865669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2418ec99-fa82-4c97-a767-6cd91a014522 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:37.866117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2418ec99-fa82-4c97-a767-6cd91a014522 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:37.866876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2418ec99-fa82-4c97-a767-6cd91a014522 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:37.867309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2418ec99-fa82-4c97-a767-6cd91a014522 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:37.896566 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2418ec99-fa82-4c97-a767-6cd91a014522 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042799 Jul 27 20:24:37.897125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 590/1139] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:24:37 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:24:37.950241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-3fe95f69-c0ea-48fc-a11b-35d03a02936d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'services' on Instance uuid 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:24:37.998350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:24:37.999125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:24:38.006933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:38.007590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:38.008341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:24:38.008801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:24:47.985174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:48.003058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=33 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:48.027544 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=38 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:13.524096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:25:13.524809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:25:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments/4839b5ab-f00f-4f5a-ae86-04e90ed65158 (ip 10.222.0.47) !!! Jul 27 20:25:24.502584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:25:24.503105 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:25:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec (ip 10.222.0.47) !!! Jul 27 20:26:18.053046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3fe95f69-c0ea-48fc-a11b-35d03a02936d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec" status: 202 len: 0 microversion: 2.1 time: 120.189768 Jul 27 20:26:18.054089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 550/1140] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:24:17 2022] DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec => generated 0 bytes in 120192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:26:18.059818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-25a8f691-210c-426a-b1bf-85af241cf27c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:18.063597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-25a8f691-210c-426a-b1bf-85af241cf27c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:18.068269 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25a8f691-210c-426a-b1bf-85af241cf27c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.069069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25a8f691-210c-426a-b1bf-85af241cf27c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.069527 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25a8f691-210c-426a-b1bf-85af241cf27c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.069963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25a8f691-210c-426a-b1bf-85af241cf27c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.083318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments/4839b5ab-f00f-4f5a-ae86-04e90ed65158 HTTP/1.1 Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:26:18.089183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:26:18.090659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'server_id': '0929536d-2d91-4e59-8f36-474025d921ef', 'id': '4839b5ab-f00f-4f5a-ae86-04e90ed65158'} Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 153, in inner Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0929536d-2d91-4e59-8f36-474025d921ef in task_state spawning. Cannot detach_volume while the instance is in this state. Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:26:18.091414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:26:18.092734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 409 to user: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:26:18.093716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-33e7ab74-d5d6-4606-b147-50c7ecfc5f20 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments/4839b5ab-f00f-4f5a-ae86-04e90ed65158" status: 409 len: 155 microversion: 2.20 time: 100.093491 Jul 27 20:26:18.093716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 591/1141] 10.222.0.47 () {60 vars in 1457 bytes} [Wed Jul 27 20:24:37 2022] DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments/4839b5ab-f00f-4f5a-ae86-04e90ed65158 => generated 155 bytes in 100095 msecs (HTTP/1.1 409) 9 headers in 380 bytes (2 switches on core 0) Jul 27 20:26:18.093952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b7e33928-c682-4a41-8988-80e94c072fb0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:18.094746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b7e33928-c682-4a41-8988-80e94c072fb0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:18.101871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7e33928-c682-4a41-8988-80e94c072fb0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.102710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7e33928-c682-4a41-8988-80e94c072fb0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.103488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7e33928-c682-4a41-8988-80e94c072fb0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.103931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7e33928-c682-4a41-8988-80e94c072fb0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.483286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-25a8f691-210c-426a-b1bf-85af241cf27c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:18.491175 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-25a8f691-210c-426a-b1bf-85af241cf27c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.435968 Jul 27 20:26:18.491747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 551/1142] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:18 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:18.496235 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-98dc553d-14be-46f6-8437-ca016ce35e70 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:18.498469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-98dc553d-14be-46f6-8437-ca016ce35e70 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:18.504409 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98dc553d-14be-46f6-8437-ca016ce35e70 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.504870 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98dc553d-14be-46f6-8437-ca016ce35e70 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.505639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98dc553d-14be-46f6-8437-ca016ce35e70 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.506074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98dc553d-14be-46f6-8437-ca016ce35e70 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.510016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b7e33928-c682-4a41-8988-80e94c072fb0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:18.517547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b7e33928-c682-4a41-8988-80e94c072fb0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.427918 Jul 27 20:26:18.518350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 592/1143] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:18.522610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:18.523093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:18.528614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.529056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.530312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.530743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.535505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-98dc553d-14be-46f6-8437-ca016ce35e70 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042759 Jul 27 20:26:18.536069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 552/1144] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:18 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:18.540620 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:18.541104 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:18.547173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.547617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.548363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.548823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:28.526778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=4 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:28.544206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:28.549821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=12 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:28.566515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:38.064483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'services' on Instance uuid 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:26:38.105512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments/4839b5ab-f00f-4f5a-ae86-04e90ed65158 HTTP/1.1 Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:26:38.107153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:26:38.109018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'server_id': '0929536d-2d91-4e59-8f36-474025d921ef', 'id': '4839b5ab-f00f-4f5a-ae86-04e90ed65158'} Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 153, in inner Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0929536d-2d91-4e59-8f36-474025d921ef in task_state spawning. Cannot detach_volume while the instance is in this state. Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:26:38.109769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:26:38.111032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 409 to user: Cannot 'detach_volume' instance 0929536d-2d91-4e59-8f36-474025d921ef while it is in task_state spawning {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:26:38.111987 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-62f621d0-fb6d-44d8-b07c-ea6a8bdb73db tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments/4839b5ab-f00f-4f5a-ae86-04e90ed65158" status: 409 len: 155 microversion: 2.20 time: 19.571784 Jul 27 20:26:38.111987 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 553/1145] 10.222.0.47 () {60 vars in 1457 bytes} [Wed Jul 27 20:26:18 2022] DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments/4839b5ab-f00f-4f5a-ae86-04e90ed65158 => generated 155 bytes in 19573 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:26:38.114406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7434288d-75ac-488c-a4fd-c3f3df8e29a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:38.115018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7434288d-75ac-488c-a4fd-c3f3df8e29a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:38.120867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7434288d-75ac-488c-a4fd-c3f3df8e29a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.121317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7434288d-75ac-488c-a4fd-c3f3df8e29a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.122075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7434288d-75ac-488c-a4fd-c3f3df8e29a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.122512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7434288d-75ac-488c-a4fd-c3f3df8e29a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.252188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7434288d-75ac-488c-a4fd-c3f3df8e29a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:38.260187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7434288d-75ac-488c-a4fd-c3f3df8e29a8 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.149835 Jul 27 20:26:38.260750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 554/1146] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:38 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:38.265052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e7fa7523-eea5-445e-99ae-d4bd818d9b7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:38.266305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e7fa7523-eea5-445e-99ae-d4bd818d9b7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:38.271928 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7fa7523-eea5-445e-99ae-d4bd818d9b7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.272393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7fa7523-eea5-445e-99ae-d4bd818d9b7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.273198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7fa7523-eea5-445e-99ae-d4bd818d9b7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.273637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7fa7523-eea5-445e-99ae-d4bd818d9b7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.406585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7fa7523-eea5-445e-99ae-d4bd818d9b7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:38.414001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e7fa7523-eea5-445e-99ae-d4bd818d9b7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1567 microversion: 2.1 time: 0.152320 Jul 27 20:26:38.414570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 555/1147] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:38.419043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f1f114ce-d30f-478d-9fe5-a65c3db7294a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:38.421241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f1f114ce-d30f-478d-9fe5-a65c3db7294a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:38.427279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1f114ce-d30f-478d-9fe5-a65c3db7294a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.427717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1f114ce-d30f-478d-9fe5-a65c3db7294a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.428484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1f114ce-d30f-478d-9fe5-a65c3db7294a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.428912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1f114ce-d30f-478d-9fe5-a65c3db7294a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.458201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f1f114ce-d30f-478d-9fe5-a65c3db7294a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Jul 27 20:26:38.458766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 556/1148] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:38 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:38.463216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:38.463693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:38.469296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.469736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.470476 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.470900 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:48.068619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=4 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:48.466591 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=8 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:48.488898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=24 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:49.226746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:26:49.227250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:26:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec (ip 10.222.0.47) !!! Jul 27 20:26:49.823724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:26:49.824258 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:26:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec (ip 10.222.0.47) !!! Jul 27 20:27:28.294630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:27:28.295152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:27:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec (ip 10.222.0.47) !!! Jul 27 20:28:18.260711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1aa211e9-7b29-4810-9bad-4bc887872f20) Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Request method failure captured: Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec HTTP/1.1 Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZylluivMbvq1djrnXMUVeBVGunbYVXh6D3d_iyn1pPfemmbHxnif7Ab9T03dfOSAK0i6Nk3WXV2mjw_fCKDeIG3-C9Rq1b76LHyCRBpFDeKwt7XcDHRJSLxWxUB8LIbDH3D__sExdSCcybRzHwVCi_z5_qVu7MkcX6Bjm1lRPdE-Bg Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:28:18.262915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8054a20f70e6408ebe06c787887d0b16", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 8f2d8cdf0e0d48f4a89a0e85694c3372 Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:28:18.264837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1aa211e9-7b29-4810-9bad-4bc887872f20) Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'server_id': '6d9fd4e2-6f6c-4826-96f5-09b52de8f200', 'id': 'dc1b3900-8a06-4de9-97a5-8c519ba578ec'} Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:28:18.266308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1aa211e9-7b29-4810-9bad-4bc887872f20) Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:28:18.269053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1aa211e9-7b29-4810-9bad-4bc887872f20) Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:18.271754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1aa211e9-7b29-4810-9bad-4bc887872f20) Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:28:18.274109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1aa211e9-7b29-4810-9bad-4bc887872f20) Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1aa211e9-7b29-4810-9bad-4bc887872f20) Jul 27 20:28:18.280752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:28:18.282946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1aa211e9-7b29-4810-9bad-4bc887872f20) {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:28:18.282946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ea3611fd-8b88-455b-bd8e-a50f5847c2d1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec" status: 400 len: 269 microversion: 2.1 time: 119.745617 Jul 27 20:28:18.282946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 593/1149] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:26:18 2022] DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec => generated 269 bytes in 119747 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:28:18.282946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d8546baf-aaf1-465c-bc6b-4b2713227a92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:18.283647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d8546baf-aaf1-465c-bc6b-4b2713227a92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:18.283647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8546baf-aaf1-465c-bc6b-4b2713227a92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.283647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8546baf-aaf1-465c-bc6b-4b2713227a92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.283647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8546baf-aaf1-465c-bc6b-4b2713227a92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.284152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8546baf-aaf1-465c-bc6b-4b2713227a92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.312722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d8546baf-aaf1-465c-bc6b-4b2713227a92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046195 Jul 27 20:28:18.314278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 594/1150] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:18 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:18.317727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a0cfad63-960b-4056-8be7-08cf48dcbd7c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:18.318325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a0cfad63-960b-4056-8be7-08cf48dcbd7c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:18.324682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0cfad63-960b-4056-8be7-08cf48dcbd7c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.325134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0cfad63-960b-4056-8be7-08cf48dcbd7c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.326182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0cfad63-960b-4056-8be7-08cf48dcbd7c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.326698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0cfad63-960b-4056-8be7-08cf48dcbd7c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.369472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'services' on Instance uuid 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:28:18.461368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0cfad63-960b-4056-8be7-08cf48dcbd7c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:18.469814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a0cfad63-960b-4056-8be7-08cf48dcbd7c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.155615 Jul 27 20:28:18.470385 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 595/1151] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:18 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:18.474696 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b033397f-8631-4282-9ccd-8ff08a969e6e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:18.475188 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b033397f-8631-4282-9ccd-8ff08a969e6e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:18.481319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b033397f-8631-4282-9ccd-8ff08a969e6e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.481765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b033397f-8631-4282-9ccd-8ff08a969e6e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.482522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b033397f-8631-4282-9ccd-8ff08a969e6e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.482956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b033397f-8631-4282-9ccd-8ff08a969e6e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.506873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b033397f-8631-4282-9ccd-8ff08a969e6e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:28:18.776474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b033397f-8631-4282-9ccd-8ff08a969e6e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "DELETE /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 204 len: 0 microversion: 2.1 time: 0.304851 Jul 27 20:28:18.777063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 596/1152] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:28:18 2022] DELETE /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:28:18.834163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-2bd6e318-5988-4beb-ae73-a5946dff2b12 req-da786d4f-4773-4623-bbe6-72726e3cd7ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af31f4cf-e692-45de-8dd8-242a7c0279fa", "tag": "94ac9417-69b9-4849-a622-d6629e497fed"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:28:18.844129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-2bd6e318-5988-4beb-ae73-a5946dff2b12 req-da786d4f-4773-4623-bbe6-72726e3cd7ab service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.844670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-2bd6e318-5988-4beb-ae73-a5946dff2b12 req-da786d4f-4773-4623-bbe6-72726e3cd7ab service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.857332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-2bd6e318-5988-4beb-ae73-a5946dff2b12 req-da786d4f-4773-4623-bbe6-72726e3cd7ab service nova] Creating event network-changed:94ac9417-69b9-4849-a622-d6629e497fed for instance af31f4cf-e692-45de-8dd8-242a7c0279fa on hv-cinder-85124 Jul 27 20:28:18.862398 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-2bd6e318-5988-4beb-ae73-a5946dff2b12 req-da786d4f-4773-4623-bbe6-72726e3cd7ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083811 Jul 27 20:28:18.863005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 597/1153] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:18.868328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-864ab7e1-bcc4-456b-8260-04d8d6e3567b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:18.870510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-864ab7e1-bcc4-456b-8260-04d8d6e3567b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:18.876432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-864ab7e1-bcc4-456b-8260-04d8d6e3567b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.876888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-864ab7e1-bcc4-456b-8260-04d8d6e3567b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.877641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-864ab7e1-bcc4-456b-8260-04d8d6e3567b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.878076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-864ab7e1-bcc4-456b-8260-04d8d6e3567b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.906930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-864ab7e1-bcc4-456b-8260-04d8d6e3567b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042719 Jul 27 20:28:18.907486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 598/1154] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:18 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:18.912232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:18.912790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:18.918375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.918826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.919604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.920042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:28.381959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:28.917011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:28.938232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:33.534344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:28:33.534913 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:28:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec (ip 10.222.0.47) !!! Jul 27 20:28:38.265279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a1dd6b63-dede-41e9-9ecf-6a84e7892e76) Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Request method failure captured: Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec HTTP/1.1 Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZylluivMbvq1djrnXMUVeBVGunbYVXh6D3d_iyn1pPfemmbHxnif7Ab9T03dfOSAK0i6Nk3WXV2mjw_fCKDeIG3-C9Rq1b76LHyCRBpFDeKwt7XcDHRJSLxWxUB8LIbDH3D__sExdSCcybRzHwVCi_z5_qVu7MkcX6Bjm1lRPdE-Bg Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:28:38.271416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8054a20f70e6408ebe06c787887d0b16", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 8f2d8cdf0e0d48f4a89a0e85694c3372 Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:28:38.273497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a1dd6b63-dede-41e9-9ecf-6a84e7892e76) Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'server_id': '6d9fd4e2-6f6c-4826-96f5-09b52de8f200', 'id': 'dc1b3900-8a06-4de9-97a5-8c519ba578ec'} Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:28:38.274137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a1dd6b63-dede-41e9-9ecf-6a84e7892e76) Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:28:38.275206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a1dd6b63-dede-41e9-9ecf-6a84e7892e76) Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:38.276333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a1dd6b63-dede-41e9-9ecf-6a84e7892e76) Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:28:38.277823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a1dd6b63-dede-41e9-9ecf-6a84e7892e76) Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a1dd6b63-dede-41e9-9ecf-6a84e7892e76) Jul 27 20:28:38.279148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:28:38.280793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a1dd6b63-dede-41e9-9ecf-6a84e7892e76) {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:28:38.280793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6f015326-9b56-4791-97a8-1c1059e7224c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec" status: 400 len: 269 microversion: 2.1 time: 119.809211 Jul 27 20:28:38.280793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 557/1155] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:26:38 2022] DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec => generated 269 bytes in 119810 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:28:38.280793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fab393d5-e28f-47a6-977c-7cc90c362069 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:38.281205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fab393d5-e28f-47a6-977c-7cc90c362069 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:38.284833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fab393d5-e28f-47a6-977c-7cc90c362069 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.285277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fab393d5-e28f-47a6-977c-7cc90c362069 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.286030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fab393d5-e28f-47a6-977c-7cc90c362069 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.286459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fab393d5-e28f-47a6-977c-7cc90c362069 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.315459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'services' on Instance uuid 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:28:38.317055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fab393d5-e28f-47a6-977c-7cc90c362069 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046638 Jul 27 20:28:38.317984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 558/1156] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:38 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:38.322257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e3654a43-d239-44a8-ae37-ae249a73d451 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:38.326050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e3654a43-d239-44a8-ae37-ae249a73d451 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:38.332422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3654a43-d239-44a8-ae37-ae249a73d451 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.332422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3654a43-d239-44a8-ae37-ae249a73d451 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.332422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3654a43-d239-44a8-ae37-ae249a73d451 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.332422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3654a43-d239-44a8-ae37-ae249a73d451 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.460914 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e3654a43-d239-44a8-ae37-ae249a73d451 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:38.469457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e3654a43-d239-44a8-ae37-ae249a73d451 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.150622 Jul 27 20:28:38.470032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 559/1157] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:38 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:38.474432 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e8e65b9c-8821-4c8a-9753-f12c790c943e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:38.474925 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e8e65b9c-8821-4c8a-9753-f12c790c943e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:38.481299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8e65b9c-8821-4c8a-9753-f12c790c943e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.481746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8e65b9c-8821-4c8a-9753-f12c790c943e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.482500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8e65b9c-8821-4c8a-9753-f12c790c943e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.483070 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8e65b9c-8821-4c8a-9753-f12c790c943e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.507762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e8e65b9c-8821-4c8a-9753-f12c790c943e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:28:38.635688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.compute.api [None req-e8e65b9c-8821-4c8a-9753-f12c790c943e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Instance is already in deleting state, ignoring this request Jul 27 20:28:38.636550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e8e65b9c-8821-4c8a-9753-f12c790c943e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "DELETE /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 204 len: 0 microversion: 2.1 time: 0.165573 Jul 27 20:28:38.637118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 560/1158] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:28:38 2022] DELETE /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:28:38.641927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c8f0d540-0aeb-456c-82a7-07b9fbf66d0a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:38.644137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c8f0d540-0aeb-456c-82a7-07b9fbf66d0a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:38.649760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8f0d540-0aeb-456c-82a7-07b9fbf66d0a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.650209 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8f0d540-0aeb-456c-82a7-07b9fbf66d0a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.650963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8f0d540-0aeb-456c-82a7-07b9fbf66d0a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.651399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8f0d540-0aeb-456c-82a7-07b9fbf66d0a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.681633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c8f0d540-0aeb-456c-82a7-07b9fbf66d0a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Jul 27 20:28:38.682162 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 561/1159] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:38 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:38.686561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:38.687037 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:38.692502 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.692942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.693679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.694106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:44.510835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:28:44.511425 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec (ip 10.222.0.47) !!! Jul 27 20:28:47.563316 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:28:47.563938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:28:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec (ip 10.222.0.47) !!! Jul 27 20:28:48.327880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=4 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:48.690482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=10 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:48.713688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:09.236314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:30:09.236969 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:30:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec (ip 10.222.0.47) !!! Jul 27 20:30:09.833122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:30:09.833682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:30:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec (ip 10.222.0.47) !!! Jul 27 20:30:18.636414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91a17e24-76ea-420c-8348-cf410b051de5) Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Request method failure captured: Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec HTTP/1.1 Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZylluivMbvq1djrnXMUVeBVGunbYVXh6D3d_iyn1pPfemmbHxnif7Ab9T03dfOSAK0i6Nk3WXV2mjw_fCKDeIG3-C9Rq1b76LHyCRBpFDeKwt7XcDHRJSLxWxUB8LIbDH3D__sExdSCcybRzHwVCi_z5_qVu7MkcX6Bjm1lRPdE-Bg Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:30:18.638831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8054a20f70e6408ebe06c787887d0b16", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 8f2d8cdf0e0d48f4a89a0e85694c3372 Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:30:18.640223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91a17e24-76ea-420c-8348-cf410b051de5) Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'server_id': '6d9fd4e2-6f6c-4826-96f5-09b52de8f200', 'id': 'dc1b3900-8a06-4de9-97a5-8c519ba578ec'} Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:30:18.641177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91a17e24-76ea-420c-8348-cf410b051de5) Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:30:18.642593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91a17e24-76ea-420c-8348-cf410b051de5) Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:18.645292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91a17e24-76ea-420c-8348-cf410b051de5) Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:30:18.646498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91a17e24-76ea-420c-8348-cf410b051de5) Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91a17e24-76ea-420c-8348-cf410b051de5) Jul 27 20:30:18.647824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:18.649154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91a17e24-76ea-420c-8348-cf410b051de5) {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:30:18.649154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c82dfe3b-4b9e-4e0c-913c-64577f466a55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec" status: 400 len: 269 microversion: 2.1 time: 119.731733 Jul 27 20:30:18.649154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 599/1160] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:28:18 2022] DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec => generated 269 bytes in 119733 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:30:18.649154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-30636523-f865-4cb0-834f-2331019fec56 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:18.649494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-30636523-f865-4cb0-834f-2331019fec56 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:18.655651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30636523-f865-4cb0-834f-2331019fec56 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:18.656102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30636523-f865-4cb0-834f-2331019fec56 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:18.656886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30636523-f865-4cb0-834f-2331019fec56 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:18.657312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30636523-f865-4cb0-834f-2331019fec56 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:18.688809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-30636523-f865-4cb0-834f-2331019fec56 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046705 Jul 27 20:30:18.689632 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 600/1161] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:18 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:18.693924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'services' on Instance uuid 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:30:18.694414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-346ccbad-9372-44b1-9b5e-a42d00491024 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:18.695011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-346ccbad-9372-44b1-9b5e-a42d00491024 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:18.700756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-346ccbad-9372-44b1-9b5e-a42d00491024 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:18.701201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-346ccbad-9372-44b1-9b5e-a42d00491024 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:18.702140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-346ccbad-9372-44b1-9b5e-a42d00491024 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:18.702568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-346ccbad-9372-44b1-9b5e-a42d00491024 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:18.833822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-346ccbad-9372-44b1-9b5e-a42d00491024 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:18.841682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-346ccbad-9372-44b1-9b5e-a42d00491024 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1448 microversion: 2.1 time: 0.150875 Jul 27 20:30:18.842848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 601/1162] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1448 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:18.962572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-77334d7c-dc80-4412-a559-ed3517aa2e13 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:18.963307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-77334d7c-dc80-4412-a559-ed3517aa2e13 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:18.970181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-77334d7c-dc80-4412-a559-ed3517aa2e13 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:18.970587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-77334d7c-dc80-4412-a559-ed3517aa2e13 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:18.971350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-77334d7c-dc80-4412-a559-ed3517aa2e13 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:18.971790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-77334d7c-dc80-4412-a559-ed3517aa2e13 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:19.106563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-77334d7c-dc80-4412-a559-ed3517aa2e13 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:19.115510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-77334d7c-dc80-4412-a559-ed3517aa2e13 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1733 microversion: 2.1 time: 0.271437 Jul 27 20:30:19.116596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 602/1163] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:18 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1733 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:19.233812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6c80af71-40aa-4694-b52f-d8773fa0ae34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:19.236069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6c80af71-40aa-4694-b52f-d8773fa0ae34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:19.242234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c80af71-40aa-4694-b52f-d8773fa0ae34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.242674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c80af71-40aa-4694-b52f-d8773fa0ae34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:19.243414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c80af71-40aa-4694-b52f-d8773fa0ae34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.243840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c80af71-40aa-4694-b52f-d8773fa0ae34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:19.311010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6c80af71-40aa-4694-b52f-d8773fa0ae34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193355 Jul 27 20:30:19.311611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 603/1164] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:19 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:19.316055 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:19.317427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:19.323084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.323521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:19.324264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.324715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:28.707522 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:29.320810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=10 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:29.343059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:38.534702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc85190-6a75-499e-9ab0-5a6e665eaf9f) Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Request method failure captured: Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec HTTP/1.1 Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZylluivMbvq1djrnXMUVeBVGunbYVXh6D3d_iyn1pPfemmbHxnif7Ab9T03dfOSAK0i6Nk3WXV2mjw_fCKDeIG3-C9Rq1b76LHyCRBpFDeKwt7XcDHRJSLxWxUB8LIbDH3D__sExdSCcybRzHwVCi_z5_qVu7MkcX6Bjm1lRPdE-Bg Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:30:38.537062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8054a20f70e6408ebe06c787887d0b16", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 8f2d8cdf0e0d48f4a89a0e85694c3372 Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:30:38.538344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc85190-6a75-499e-9ab0-5a6e665eaf9f) Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'server_id': '6d9fd4e2-6f6c-4826-96f5-09b52de8f200', 'id': 'dc1b3900-8a06-4de9-97a5-8c519ba578ec'} Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:30:38.539649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc85190-6a75-499e-9ab0-5a6e665eaf9f) Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:30:38.540709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc85190-6a75-499e-9ab0-5a6e665eaf9f) Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.541784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc85190-6a75-499e-9ab0-5a6e665eaf9f) Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:30:38.542747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc85190-6a75-499e-9ab0-5a6e665eaf9f) Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc85190-6a75-499e-9ab0-5a6e665eaf9f) Jul 27 20:30:38.543818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.545402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc85190-6a75-499e-9ab0-5a6e665eaf9f) {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:30:38.545402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2efa7947-eb5e-419e-9786-381af4a5ec61 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec" status: 400 len: 269 microversion: 2.1 time: 119.855462 Jul 27 20:30:38.545402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 562/1165] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:28:38 2022] DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec => generated 269 bytes in 119856 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:30:38.545834 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-af3bbb40-537a-434b-a6f0-a75c6b09abe7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:38.548866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-af3bbb40-537a-434b-a6f0-a75c6b09abe7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:38.556020 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af3bbb40-537a-434b-a6f0-a75c6b09abe7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.556510 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af3bbb40-537a-434b-a6f0-a75c6b09abe7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.557504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af3bbb40-537a-434b-a6f0-a75c6b09abe7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.558085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af3bbb40-537a-434b-a6f0-a75c6b09abe7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.585642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'services' on Instance uuid 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:30:38.590327 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-af3bbb40-537a-434b-a6f0-a75c6b09abe7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049931 Jul 27 20:30:38.591090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 563/1166] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:38 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:38.596243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-166d058c-c2c3-45f4-aee5-da9f525c3931 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:38.596911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-166d058c-c2c3-45f4-aee5-da9f525c3931 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:38.602846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-166d058c-c2c3-45f4-aee5-da9f525c3931 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.603292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-166d058c-c2c3-45f4-aee5-da9f525c3931 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.604055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-166d058c-c2c3-45f4-aee5-da9f525c3931 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.604514 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-166d058c-c2c3-45f4-aee5-da9f525c3931 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.647107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75e1a7b0-9af4-454e-ab42-952942cb2893) Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Request method failure captured: Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec HTTP/1.1 Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZylluivMbvq1djrnXMUVeBVGunbYVXh6D3d_iyn1pPfemmbHxnif7Ab9T03dfOSAK0i6Nk3WXV2mjw_fCKDeIG3-C9Rq1b76LHyCRBpFDeKwt7XcDHRJSLxWxUB8LIbDH3D__sExdSCcybRzHwVCi_z5_qVu7MkcX6Bjm1lRPdE-Bg Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:30:38.649322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8054a20f70e6408ebe06c787887d0b16", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 8f2d8cdf0e0d48f4a89a0e85694c3372 Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:30:38.650650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75e1a7b0-9af4-454e-ab42-952942cb2893) Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'server_id': '6d9fd4e2-6f6c-4826-96f5-09b52de8f200', 'id': 'dc1b3900-8a06-4de9-97a5-8c519ba578ec'} Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:30:38.651241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75e1a7b0-9af4-454e-ab42-952942cb2893) Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:30:38.652298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75e1a7b0-9af4-454e-ab42-952942cb2893) Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.653538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75e1a7b0-9af4-454e-ab42-952942cb2893) Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:30:38.656803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75e1a7b0-9af4-454e-ab42-952942cb2893) Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75e1a7b0-9af4-454e-ab42-952942cb2893) Jul 27 20:30:38.658069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:30:38.659259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75e1a7b0-9af4-454e-ab42-952942cb2893) {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:30:38.659259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4205cc6b-ed40-4ef5-a79e-6dbf4ff65231 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec" status: 400 len: 269 microversion: 2.1 time: 19.338237 Jul 27 20:30:38.659259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 604/1167] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:30:19 2022] DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec => generated 269 bytes in 19339 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:30:38.659259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dfcf6eeb-bb69-4433-b7c8-813dbdae1021 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:38.660424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dfcf6eeb-bb69-4433-b7c8-813dbdae1021 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 541f66f3-1a9d-4587-8012-c5636c1cd2ce] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:38.666023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfcf6eeb-bb69-4433-b7c8-813dbdae1021 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.666476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfcf6eeb-bb69-4433-b7c8-813dbdae1021 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.667246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfcf6eeb-bb69-4433-b7c8-813dbdae1021 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.667686 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfcf6eeb-bb69-4433-b7c8-813dbdae1021 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.827829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-166d058c-c2c3-45f4-aee5-da9f525c3931 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:38.836913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-166d058c-c2c3-45f4-aee5-da9f525c3931 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1448 microversion: 2.1 time: 0.244055 Jul 27 20:30:38.838022 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 564/1168] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1448 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:38.843702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6b9b2fa9-6d6e-415f-8f34-86b91cf9ebfc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:38.846101 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6b9b2fa9-6d6e-415f-8f34-86b91cf9ebfc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:38.853863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b9b2fa9-6d6e-415f-8f34-86b91cf9ebfc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.855025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b9b2fa9-6d6e-415f-8f34-86b91cf9ebfc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.855809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b9b2fa9-6d6e-415f-8f34-86b91cf9ebfc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.856250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b9b2fa9-6d6e-415f-8f34-86b91cf9ebfc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.887516 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6b9b2fa9-6d6e-415f-8f34-86b91cf9ebfc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048046 Jul 27 20:30:38.888359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 565/1169] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:38 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:38.894320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:38.894699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfcf6eeb-bb69-4433-b7c8-813dbdae1021 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:38.894845 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:38.901178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.901877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.902648 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.903083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.919078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dfcf6eeb-bb69-4433-b7c8-813dbdae1021 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce" status: 200 len: 1687 microversion: 2.1 time: 0.266438 Jul 27 20:30:38.919947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 605/1170] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:38 2022] GET /compute/v2.1/servers/541f66f3-1a9d-4587-8012-c5636c1cd2ce => generated 1687 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:38.938003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9b309437-7e7b-462f-8080-bea6ad4d1d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:38.944739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9b309437-7e7b-462f-8080-bea6ad4d1d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:38.952688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b309437-7e7b-462f-8080-bea6ad4d1d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.953449 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b309437-7e7b-462f-8080-bea6ad4d1d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.954846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b309437-7e7b-462f-8080-bea6ad4d1d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.955773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b309437-7e7b-462f-8080-bea6ad4d1d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.999812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9b309437-7e7b-462f-8080-bea6ad4d1d41 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073998 Jul 27 20:30:39.005789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 606/1171] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:38 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:39.011958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a3e9fdda-d56d-47f3-9da9-8458aa44df55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:39.012702 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a3e9fdda-d56d-47f3-9da9-8458aa44df55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:39.020651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3e9fdda-d56d-47f3-9da9-8458aa44df55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.021105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3e9fdda-d56d-47f3-9da9-8458aa44df55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.021874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3e9fdda-d56d-47f3-9da9-8458aa44df55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.022303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3e9fdda-d56d-47f3-9da9-8458aa44df55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.023634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lazy-loading 'services' on Instance uuid 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:30:39.090873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41ad1d93-ecd8-400e-84ea-411fcac58253) Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Request method failure captured: Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec HTTP/1.1 Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZylluivMbvq1djrnXMUVeBVGunbYVXh6D3d_iyn1pPfemmbHxnif7Ab9T03dfOSAK0i6Nk3WXV2mjw_fCKDeIG3-C9Rq1b76LHyCRBpFDeKwt7XcDHRJSLxWxUB8LIbDH3D__sExdSCcybRzHwVCi_z5_qVu7MkcX6Bjm1lRPdE-Bg Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:30:39.095907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8054a20f70e6408ebe06c787887d0b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8054a20f70e6408ebe06c787887d0b16", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 8054a20f70e6408ebe06c787887d0b16 Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1671077269 Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 8f2d8cdf0e0d48f4a89a0e85694c3372 Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesSnapshotTestJSON-1671077269-project Jul 27 20:30:39.097550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41ad1d93-ecd8-400e-84ea-411fcac58253) Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'server_id': '6d9fd4e2-6f6c-4826-96f5-09b52de8f200', 'id': 'dc1b3900-8a06-4de9-97a5-8c519ba578ec'} Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:30:39.098161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41ad1d93-ecd8-400e-84ea-411fcac58253) Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:30:39.099153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41ad1d93-ecd8-400e-84ea-411fcac58253) Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:39.100293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41ad1d93-ecd8-400e-84ea-411fcac58253) Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:30:39.102324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41ad1d93-ecd8-400e-84ea-411fcac58253) Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41ad1d93-ecd8-400e-84ea-411fcac58253) Jul 27 20:30:39.104472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:30:39.106417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41ad1d93-ecd8-400e-84ea-411fcac58253) {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:30:39.106417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-19e599f8-7e5a-4123-8dff-5201a6819933 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec" status: 400 len: 269 microversion: 2.1 time: 0.214019 Jul 27 20:30:39.110512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 566/1172] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:30:38 2022] DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200/os-volume_attachments/dc1b3900-8a06-4de9-97a5-8c519ba578ec => generated 269 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:30:39.118731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-17528845-6cb5-4b9b-90a6-dda30d25d86c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '.version_select at 0x7f35ca2e2b80>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:39.208253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-17528845-6cb5-4b9b-90a6-dda30d25d86c tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-555757349" status: 202 len: 0 microversion: 2.1 time: 0.096262 Jul 27 20:30:39.208899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 567/1173] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Jul 27 20:30:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-555757349 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:30:39.257366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3e9fdda-d56d-47f3-9da9-8458aa44df55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:39.257366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a3e9fdda-d56d-47f3-9da9-8458aa44df55 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1448 microversion: 2.1 time: 0.249035 Jul 27 20:30:39.257366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 607/1174] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1448 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:39.584581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-c7a1f975-6958-41c8-9882-20543c8b7c5f req-5ad18da0-bffa-41c1-8c43-183055528fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31f4cf-e692-45de-8dd8-242a7c0279fa", "name": "network-vif-deleted", "tag": "94ac9417-69b9-4849-a622-d6629e497fed"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:30:39.603610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-c7a1f975-6958-41c8-9882-20543c8b7c5f req-5ad18da0-bffa-41c1-8c43-183055528fd9 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.604064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-c7a1f975-6958-41c8-9882-20543c8b7c5f req-5ad18da0-bffa-41c1-8c43-183055528fd9 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.618083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-c7a1f975-6958-41c8-9882-20543c8b7c5f req-5ad18da0-bffa-41c1-8c43-183055528fd9 service nova] Creating event network-vif-deleted:94ac9417-69b9-4849-a622-d6629e497fed for instance af31f4cf-e692-45de-8dd8-242a7c0279fa on hv-cinder-85124 Jul 27 20:30:39.625191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-c7a1f975-6958-41c8-9882-20543c8b7c5f req-5ad18da0-bffa-41c1-8c43-183055528fd9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043966 Jul 27 20:30:39.636749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 568/1175] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:39.906874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6566022f-be8d-4bbd-8f8e-e6d1a95b810c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:30:39.909157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6566022f-be8d-4bbd-8f8e-e6d1a95b810c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:39.917672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6566022f-be8d-4bbd-8f8e-e6d1a95b810c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.918167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6566022f-be8d-4bbd-8f8e-e6d1a95b810c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.918942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6566022f-be8d-4bbd-8f8e-e6d1a95b810c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.919374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6566022f-be8d-4bbd-8f8e-e6d1a95b810c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.947373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6566022f-be8d-4bbd-8f8e-e6d1a95b810c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [e10a782e-6b2d-4dcd-a2c6-61d90aae5c0d] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 20:30:40.015624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6a06b28d-2264-4f08-9109-e98b203e22f5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:40.018046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6a06b28d-2264-4f08-9109-e98b203e22f5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:40.030390 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6a06b28d-2264-4f08-9109-e98b203e22f5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.031939 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6a06b28d-2264-4f08-9109-e98b203e22f5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.033039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6a06b28d-2264-4f08-9109-e98b203e22f5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.033678 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6a06b28d-2264-4f08-9109-e98b203e22f5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.071313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6a06b28d-2264-4f08-9109-e98b203e22f5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061746 Jul 27 20:30:40.073312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 569/1176] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:40.277494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4028edbd-dbd5-420f-a582-4c507cec422b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:40.278277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4028edbd-dbd5-420f-a582-4c507cec422b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:40.286873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4028edbd-dbd5-420f-a582-4c507cec422b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.287646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4028edbd-dbd5-420f-a582-4c507cec422b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.288687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4028edbd-dbd5-420f-a582-4c507cec422b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.289341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4028edbd-dbd5-420f-a582-4c507cec422b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.631903 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4028edbd-dbd5-420f-a582-4c507cec422b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:40.657835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4028edbd-dbd5-420f-a582-4c507cec422b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.369502 Jul 27 20:30:40.657835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 570/1177] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:40 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:40.731854 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-8d28df39-0f95-4099-b355-612600207803 req-6df789b1-e3dd-4692-8eaa-c9edff7e10da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541f66f3-1a9d-4587-8012-c5636c1cd2ce", "tag": "60ef2664-40a6-420e-85c7-230bee398552"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:30:40.748065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-8d28df39-0f95-4099-b355-612600207803 req-6df789b1-e3dd-4692-8eaa-c9edff7e10da service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.748799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-8d28df39-0f95-4099-b355-612600207803 req-6df789b1-e3dd-4692-8eaa-c9edff7e10da service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.762806 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-8d28df39-0f95-4099-b355-612600207803 req-6df789b1-e3dd-4692-8eaa-c9edff7e10da service nova] Creating event network-changed:60ef2664-40a6-420e-85c7-230bee398552 for instance 541f66f3-1a9d-4587-8012-c5636c1cd2ce on hv-cinder-85124 Jul 27 20:30:40.768956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-8d28df39-0f95-4099-b355-612600207803 req-6df789b1-e3dd-4692-8eaa-c9edff7e10da service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110044 Jul 27 20:30:40.770603 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 571/1178] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:40.958074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [None req-6566022f-be8d-4bbd-8f8e-e6d1a95b810c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [e10a782e-6b2d-4dcd-a2c6-61d90aae5c0d] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 47012. Jul 27 20:30:41.059094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6566022f-be8d-4bbd-8f8e-e6d1a95b810c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "POST /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/action" status: 200 len: 76502 microversion: 2.1 time: 1.161597 Jul 27 20:30:41.059777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 608/1179] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:30:39 2022] POST /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d/action => generated 76502 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:41.088371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ce6b4471-b9d4-401c-b9bd-68346bf26767 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:41.092813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ce6b4471-b9d4-401c-b9bd-68346bf26767 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:41.112535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce6b4471-b9d4-401c-b9bd-68346bf26767 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:41.115812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce6b4471-b9d4-401c-b9bd-68346bf26767 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:41.119857 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce6b4471-b9d4-401c-b9bd-68346bf26767 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:41.122420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce6b4471-b9d4-401c-b9bd-68346bf26767 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:41.186366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ce6b4471-b9d4-401c-b9bd-68346bf26767 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102686 Jul 27 20:30:41.191820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 572/1180] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:41 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:41.645947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-71c814c7-67c7-4209-b7d7-649e9a71332f req-26bb04dd-34fc-4379-8ccc-139ec1fb5c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541f66f3-1a9d-4587-8012-c5636c1cd2ce", "name": "network-vif-deleted", "tag": "60ef2664-40a6-420e-85c7-230bee398552"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:30:41.670613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8ef84664-5c40-4411-8d41-7a70fe83c1aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:41.671212 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8ef84664-5c40-4411-8d41-7a70fe83c1aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:41.674008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-71c814c7-67c7-4209-b7d7-649e9a71332f req-26bb04dd-34fc-4379-8ccc-139ec1fb5c57 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:41.675467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-71c814c7-67c7-4209-b7d7-649e9a71332f req-26bb04dd-34fc-4379-8ccc-139ec1fb5c57 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:41.680923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ef84664-5c40-4411-8d41-7a70fe83c1aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:41.681372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ef84664-5c40-4411-8d41-7a70fe83c1aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:41.682139 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ef84664-5c40-4411-8d41-7a70fe83c1aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:41.682577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ef84664-5c40-4411-8d41-7a70fe83c1aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:41.702436 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-71c814c7-67c7-4209-b7d7-649e9a71332f req-26bb04dd-34fc-4379-8ccc-139ec1fb5c57 service nova] Creating event network-vif-deleted:60ef2664-40a6-420e-85c7-230bee398552 for instance 541f66f3-1a9d-4587-8012-c5636c1cd2ce on hv-cinder-85124 Jul 27 20:30:41.713631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-71c814c7-67c7-4209-b7d7-649e9a71332f req-26bb04dd-34fc-4379-8ccc-139ec1fb5c57 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071039 Jul 27 20:30:41.715211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 609/1181] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:41.759393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ef84664-5c40-4411-8d41-7a70fe83c1aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:41.768806 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8ef84664-5c40-4411-8d41-7a70fe83c1aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.102093 Jul 27 20:30:41.769383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 573/1182] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:41 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:42.200703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2cd0c1d7-7317-459d-a68e-d3f73510d4e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:42.202982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2cd0c1d7-7317-459d-a68e-d3f73510d4e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:42.209241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2cd0c1d7-7317-459d-a68e-d3f73510d4e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.209688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2cd0c1d7-7317-459d-a68e-d3f73510d4e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.210541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2cd0c1d7-7317-459d-a68e-d3f73510d4e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.210862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2cd0c1d7-7317-459d-a68e-d3f73510d4e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.240884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2cd0c1d7-7317-459d-a68e-d3f73510d4e4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045425 Jul 27 20:30:42.241441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 610/1183] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:42.789319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3d3eb06e-2500-45b6-97dd-e067ae0aad2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:42.789931 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3d3eb06e-2500-45b6-97dd-e067ae0aad2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:42.797355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d3eb06e-2500-45b6-97dd-e067ae0aad2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.797799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d3eb06e-2500-45b6-97dd-e067ae0aad2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.798612 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d3eb06e-2500-45b6-97dd-e067ae0aad2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.799062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d3eb06e-2500-45b6-97dd-e067ae0aad2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.860456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3d3eb06e-2500-45b6-97dd-e067ae0aad2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:42.868305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3d3eb06e-2500-45b6-97dd-e067ae0aad2d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082850 Jul 27 20:30:42.868905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 574/1184] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:43.254326 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5ce52bc0-ba63-4d77-8339-7c1fcbfdd09a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:43.261869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5ce52bc0-ba63-4d77-8339-7c1fcbfdd09a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:43.269169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ce52bc0-ba63-4d77-8339-7c1fcbfdd09a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.269373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ce52bc0-ba63-4d77-8339-7c1fcbfdd09a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.270405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ce52bc0-ba63-4d77-8339-7c1fcbfdd09a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.270843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ce52bc0-ba63-4d77-8339-7c1fcbfdd09a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.302315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5ce52bc0-ba63-4d77-8339-7c1fcbfdd09a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051969 Jul 27 20:30:43.302886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 611/1185] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:43 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:43.889889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e7319c82-7661-4563-8a7c-9c11926f1a8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:43.894497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e7319c82-7661-4563-8a7c-9c11926f1a8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:43.896586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7319c82-7661-4563-8a7c-9c11926f1a8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.897028 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7319c82-7661-4563-8a7c-9c11926f1a8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.897793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7319c82-7661-4563-8a7c-9c11926f1a8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.898196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7319c82-7661-4563-8a7c-9c11926f1a8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.963254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7319c82-7661-4563-8a7c-9c11926f1a8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:43.970004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e7319c82-7661-4563-8a7c-9c11926f1a8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084720 Jul 27 20:30:43.970560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 575/1186] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:43 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:44.314741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-45bfb33c-dd8b-4c99-bd1c-bb7209113899 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:44.316902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-45bfb33c-dd8b-4c99-bd1c-bb7209113899 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:44.323345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45bfb33c-dd8b-4c99-bd1c-bb7209113899 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:44.323785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45bfb33c-dd8b-4c99-bd1c-bb7209113899 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:44.324588 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45bfb33c-dd8b-4c99-bd1c-bb7209113899 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:44.325013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-45bfb33c-dd8b-4c99-bd1c-bb7209113899 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:44.359237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-45bfb33c-dd8b-4c99-bd1c-bb7209113899 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048506 Jul 27 20:30:44.359794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 612/1187] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:44.991586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be29def4-aceb-4d48-b939-490da315f936 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:44.992565 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-be29def4-aceb-4d48-b939-490da315f936 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:44.999534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be29def4-aceb-4d48-b939-490da315f936 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:44.999978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be29def4-aceb-4d48-b939-490da315f936 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.000765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be29def4-aceb-4d48-b939-490da315f936 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:45.001205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be29def4-aceb-4d48-b939-490da315f936 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.062657 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-be29def4-aceb-4d48-b939-490da315f936 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:45.070123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-be29def4-aceb-4d48-b939-490da315f936 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082409 Jul 27 20:30:45.070695 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 576/1188] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:45.372011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-44c4aebe-2c06-46dd-ab8b-6180eb3f27d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:45.374237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-44c4aebe-2c06-46dd-ab8b-6180eb3f27d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:45.380595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44c4aebe-2c06-46dd-ab8b-6180eb3f27d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:45.381033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44c4aebe-2c06-46dd-ab8b-6180eb3f27d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.381779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44c4aebe-2c06-46dd-ab8b-6180eb3f27d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:45.382204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44c4aebe-2c06-46dd-ab8b-6180eb3f27d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.412035 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-44c4aebe-2c06-46dd-ab8b-6180eb3f27d7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044242 Jul 27 20:30:45.412613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 613/1189] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:45 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:46.090433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aad17420-56e1-457d-a287-0b9d4114d51f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:46.091047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aad17420-56e1-457d-a287-0b9d4114d51f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:46.098098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad17420-56e1-457d-a287-0b9d4114d51f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.098566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad17420-56e1-457d-a287-0b9d4114d51f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.099301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad17420-56e1-457d-a287-0b9d4114d51f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.099736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad17420-56e1-457d-a287-0b9d4114d51f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.160882 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aad17420-56e1-457d-a287-0b9d4114d51f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:46.168335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aad17420-56e1-457d-a287-0b9d4114d51f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081722 Jul 27 20:30:46.171702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 577/1190] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:46.424104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a2dbc522-0358-40ac-b7dd-abb567632f4f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:46.426175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a2dbc522-0358-40ac-b7dd-abb567632f4f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:46.432629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2dbc522-0358-40ac-b7dd-abb567632f4f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.433074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2dbc522-0358-40ac-b7dd-abb567632f4f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.433826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2dbc522-0358-40ac-b7dd-abb567632f4f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.434258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2dbc522-0358-40ac-b7dd-abb567632f4f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.464794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a2dbc522-0358-40ac-b7dd-abb567632f4f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044639 Jul 27 20:30:46.465343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 614/1191] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:46 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:47.189949 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f92861bb-63f9-4d79-96f9-db1b1c264b8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:47.190563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f92861bb-63f9-4d79-96f9-db1b1c264b8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:47.197024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f92861bb-63f9-4d79-96f9-db1b1c264b8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.197476 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f92861bb-63f9-4d79-96f9-db1b1c264b8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.198231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f92861bb-63f9-4d79-96f9-db1b1c264b8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.198670 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f92861bb-63f9-4d79-96f9-db1b1c264b8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.258948 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f92861bb-63f9-4d79-96f9-db1b1c264b8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:47.266459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f92861bb-63f9-4d79-96f9-db1b1c264b8e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080417 Jul 27 20:30:47.267030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 578/1192] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:47 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:47.476254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2149bdff-f28c-42d8-88a2-892df0ce6d46 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:47.478367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2149bdff-f28c-42d8-88a2-892df0ce6d46 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:47.484760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2149bdff-f28c-42d8-88a2-892df0ce6d46 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.490425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2149bdff-f28c-42d8-88a2-892df0ce6d46 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.490425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2149bdff-f28c-42d8-88a2-892df0ce6d46 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.490425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2149bdff-f28c-42d8-88a2-892df0ce6d46 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.516045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2149bdff-f28c-42d8-88a2-892df0ce6d46 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043853 Jul 27 20:30:47.516846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 615/1193] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:48.286960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-92e9fb7f-ccdd-45b5-88d7-1d93d200f416 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:48.287559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-92e9fb7f-ccdd-45b5-88d7-1d93d200f416 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:48.294029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-92e9fb7f-ccdd-45b5-88d7-1d93d200f416 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.294465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-92e9fb7f-ccdd-45b5-88d7-1d93d200f416 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.295273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-92e9fb7f-ccdd-45b5-88d7-1d93d200f416 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.295703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-92e9fb7f-ccdd-45b5-88d7-1d93d200f416 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.359975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-92e9fb7f-ccdd-45b5-88d7-1d93d200f416 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:48.367691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-92e9fb7f-ccdd-45b5-88d7-1d93d200f416 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084542 Jul 27 20:30:48.368250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 579/1194] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:48 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:48.528287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f8dd196d-d849-4f6a-82f4-aec883ecee1c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:48.530959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f8dd196d-d849-4f6a-82f4-aec883ecee1c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:48.537332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8dd196d-d849-4f6a-82f4-aec883ecee1c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.537778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8dd196d-d849-4f6a-82f4-aec883ecee1c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.538524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8dd196d-d849-4f6a-82f4-aec883ecee1c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.538953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8dd196d-d849-4f6a-82f4-aec883ecee1c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.567999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f8dd196d-d849-4f6a-82f4-aec883ecee1c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043656 Jul 27 20:30:48.568582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 616/1195] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:48 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:49.388581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cc0aa8e2-30ff-4372-9846-da66225135ad tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:49.389829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cc0aa8e2-30ff-4372-9846-da66225135ad tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:49.396521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc0aa8e2-30ff-4372-9846-da66225135ad tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.396980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc0aa8e2-30ff-4372-9846-da66225135ad tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.397735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc0aa8e2-30ff-4372-9846-da66225135ad tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.398184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc0aa8e2-30ff-4372-9846-da66225135ad tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.458422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cc0aa8e2-30ff-4372-9846-da66225135ad tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:49.465768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cc0aa8e2-30ff-4372-9846-da66225135ad tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081077 Jul 27 20:30:49.466333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 580/1196] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:49.579721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3282265a-c3a4-4d23-934a-661a99ed881b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:49.581938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3282265a-c3a4-4d23-934a-661a99ed881b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:49.588363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3282265a-c3a4-4d23-934a-661a99ed881b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.588864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3282265a-c3a4-4d23-934a-661a99ed881b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.589623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3282265a-c3a4-4d23-934a-661a99ed881b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.590056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3282265a-c3a4-4d23-934a-661a99ed881b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.619504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3282265a-c3a4-4d23-934a-661a99ed881b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043772 Jul 27 20:30:49.619989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 617/1197] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:50.486318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-90c54b3f-9359-4d02-853f-24e19efdd268 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:50.486954 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-90c54b3f-9359-4d02-853f-24e19efdd268 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:50.493656 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90c54b3f-9359-4d02-853f-24e19efdd268 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.495611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90c54b3f-9359-4d02-853f-24e19efdd268 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.495611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90c54b3f-9359-4d02-853f-24e19efdd268 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.495611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90c54b3f-9359-4d02-853f-24e19efdd268 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.512984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:50.555737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90c54b3f-9359-4d02-853f-24e19efdd268 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:50.563107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-90c54b3f-9359-4d02-853f-24e19efdd268 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080777 Jul 27 20:30:50.563681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 581/1198] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:50.631720 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cd976c81-32fa-4c59-959a-bd40a7797dff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:50.633853 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cd976c81-32fa-4c59-959a-bd40a7797dff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:50.640935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd976c81-32fa-4c59-959a-bd40a7797dff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.641374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd976c81-32fa-4c59-959a-bd40a7797dff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.642151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd976c81-32fa-4c59-959a-bd40a7797dff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.642600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd976c81-32fa-4c59-959a-bd40a7797dff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.671931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cd976c81-32fa-4c59-959a-bd40a7797dff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044279 Jul 27 20:30:50.672509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 618/1199] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:50 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:51.583718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f4b5f386-642e-4468-bc08-54b34c7f2e3d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:51.584325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f4b5f386-642e-4468-bc08-54b34c7f2e3d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:51.591203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4b5f386-642e-4468-bc08-54b34c7f2e3d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.591650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4b5f386-642e-4468-bc08-54b34c7f2e3d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.592945 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4b5f386-642e-4468-bc08-54b34c7f2e3d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.593379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4b5f386-642e-4468-bc08-54b34c7f2e3d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.652727 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f4b5f386-642e-4468-bc08-54b34c7f2e3d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:51.660553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f4b5f386-642e-4468-bc08-54b34c7f2e3d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080666 Jul 27 20:30:51.661114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 582/1200] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:51.683133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-062e5a19-2848-495d-a198-fa123afef385 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:51.685420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-062e5a19-2848-495d-a198-fa123afef385 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:51.691903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-062e5a19-2848-495d-a198-fa123afef385 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.692354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-062e5a19-2848-495d-a198-fa123afef385 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.693138 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-062e5a19-2848-495d-a198-fa123afef385 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.693575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-062e5a19-2848-495d-a198-fa123afef385 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.723922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-062e5a19-2848-495d-a198-fa123afef385 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044727 Jul 27 20:30:51.724507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 619/1201] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:52.682034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-572409d6-c6c8-45ee-97b4-1fe757d8223f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:52.682650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-572409d6-c6c8-45ee-97b4-1fe757d8223f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:52.689072 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-572409d6-c6c8-45ee-97b4-1fe757d8223f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:52.689526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-572409d6-c6c8-45ee-97b4-1fe757d8223f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:52.690365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-572409d6-c6c8-45ee-97b4-1fe757d8223f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:52.690808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-572409d6-c6c8-45ee-97b4-1fe757d8223f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:52.736278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a515dbf9-3438-4deb-bb08-feda8cb07180 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:52.738465 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a515dbf9-3438-4deb-bb08-feda8cb07180 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:52.745115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a515dbf9-3438-4deb-bb08-feda8cb07180 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:52.745555 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a515dbf9-3438-4deb-bb08-feda8cb07180 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:52.746305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a515dbf9-3438-4deb-bb08-feda8cb07180 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:52.746729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a515dbf9-3438-4deb-bb08-feda8cb07180 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:52.755161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-572409d6-c6c8-45ee-97b4-1fe757d8223f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:52.762639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-572409d6-c6c8-45ee-97b4-1fe757d8223f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084604 Jul 27 20:30:52.763220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 583/1202] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:52.777707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a515dbf9-3438-4deb-bb08-feda8cb07180 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045318 Jul 27 20:30:52.778264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 620/1203] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:52 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:53.783437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9aa65343-c4c3-4d1d-826c-ffa318d9ec45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:53.784077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9aa65343-c4c3-4d1d-826c-ffa318d9ec45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:53.790566 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-673782a4-3110-48f4-87c7-1b245d0432fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:53.791051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9aa65343-c4c3-4d1d-826c-ffa318d9ec45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.791385 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9aa65343-c4c3-4d1d-826c-ffa318d9ec45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.792165 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9aa65343-c4c3-4d1d-826c-ffa318d9ec45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.792633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9aa65343-c4c3-4d1d-826c-ffa318d9ec45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.794260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-673782a4-3110-48f4-87c7-1b245d0432fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:53.801113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-673782a4-3110-48f4-87c7-1b245d0432fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.801637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-673782a4-3110-48f4-87c7-1b245d0432fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.802488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-673782a4-3110-48f4-87c7-1b245d0432fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.802986 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-673782a4-3110-48f4-87c7-1b245d0432fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.831196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:53.835655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-673782a4-3110-48f4-87c7-1b245d0432fe tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049067 Jul 27 20:30:53.836220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 621/1204] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:53 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:53.858324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9aa65343-c4c3-4d1d-826c-ffa318d9ec45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:53.865251 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9aa65343-c4c3-4d1d-826c-ffa318d9ec45 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085752 Jul 27 20:30:53.865818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 584/1205] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:54.847833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b2e64d91-c1bf-4d81-982b-69ef52ce8eaf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:54.850000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b2e64d91-c1bf-4d81-982b-69ef52ce8eaf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:54.857048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2e64d91-c1bf-4d81-982b-69ef52ce8eaf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.857498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2e64d91-c1bf-4d81-982b-69ef52ce8eaf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.858843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2e64d91-c1bf-4d81-982b-69ef52ce8eaf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.859260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2e64d91-c1bf-4d81-982b-69ef52ce8eaf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.886746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6b0567c8-2622-4ef9-a8df-bfc4b1b4ddc4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:54.887363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6b0567c8-2622-4ef9-a8df-bfc4b1b4ddc4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:54.887771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b2e64d91-c1bf-4d81-982b-69ef52ce8eaf tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044087 Jul 27 20:30:54.888336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 622/1206] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:54 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:54.894311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b0567c8-2622-4ef9-a8df-bfc4b1b4ddc4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.894762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b0567c8-2622-4ef9-a8df-bfc4b1b4ddc4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.895528 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b0567c8-2622-4ef9-a8df-bfc4b1b4ddc4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.895993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b0567c8-2622-4ef9-a8df-bfc4b1b4ddc4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.955844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6b0567c8-2622-4ef9-a8df-bfc4b1b4ddc4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:54.963311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6b0567c8-2622-4ef9-a8df-bfc4b1b4ddc4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080419 Jul 27 20:30:54.963873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 585/1207] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:54 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:55.900803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-93e3d21a-463d-423c-b918-afd876cb8a06 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:55.902962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-93e3d21a-463d-423c-b918-afd876cb8a06 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:55.909336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93e3d21a-463d-423c-b918-afd876cb8a06 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.909778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93e3d21a-463d-423c-b918-afd876cb8a06 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:55.910528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93e3d21a-463d-423c-b918-afd876cb8a06 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.910955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93e3d21a-463d-423c-b918-afd876cb8a06 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:55.940595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-93e3d21a-463d-423c-b918-afd876cb8a06 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043802 Jul 27 20:30:55.941149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 623/1208] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:55 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:55.985186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8f874d05-9d56-48a7-b67d-360d71c1b802 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:55.985804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8f874d05-9d56-48a7-b67d-360d71c1b802 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:55.992505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8f874d05-9d56-48a7-b67d-360d71c1b802 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.992956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8f874d05-9d56-48a7-b67d-360d71c1b802 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:55.993713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8f874d05-9d56-48a7-b67d-360d71c1b802 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.994147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8f874d05-9d56-48a7-b67d-360d71c1b802 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:56.056299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8f874d05-9d56-48a7-b67d-360d71c1b802 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:56.063784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8f874d05-9d56-48a7-b67d-360d71c1b802 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083282 Jul 27 20:30:56.064355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 586/1209] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:56.952354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a9f7b407-b364-476b-b4e4-ecd8b8bd36bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:56.955043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a9f7b407-b364-476b-b4e4-ecd8b8bd36bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:56.961622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a9f7b407-b364-476b-b4e4-ecd8b8bd36bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:56.962073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a9f7b407-b364-476b-b4e4-ecd8b8bd36bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:56.962834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a9f7b407-b364-476b-b4e4-ecd8b8bd36bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:56.963276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a9f7b407-b364-476b-b4e4-ecd8b8bd36bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:56.991481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a9f7b407-b364-476b-b4e4-ecd8b8bd36bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043128 Jul 27 20:30:56.992294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 624/1210] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:57.084597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b9763b6e-e298-4c47-8834-9d0e4d5e42ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:57.085212 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b9763b6e-e298-4c47-8834-9d0e4d5e42ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:57.091617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9763b6e-e298-4c47-8834-9d0e4d5e42ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:57.092593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9763b6e-e298-4c47-8834-9d0e4d5e42ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:57.093347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9763b6e-e298-4c47-8834-9d0e4d5e42ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:57.093780 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b9763b6e-e298-4c47-8834-9d0e4d5e42ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:57.157214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b9763b6e-e298-4c47-8834-9d0e4d5e42ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:57.164602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b9763b6e-e298-4c47-8834-9d0e4d5e42ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083801 Jul 27 20:30:57.165167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 587/1211] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:58.004452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ee20af51-336a-4f69-90f9-83e0d42c212c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:58.006607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ee20af51-336a-4f69-90f9-83e0d42c212c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:58.013012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee20af51-336a-4f69-90f9-83e0d42c212c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.013432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee20af51-336a-4f69-90f9-83e0d42c212c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.014708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee20af51-336a-4f69-90f9-83e0d42c212c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.015140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee20af51-336a-4f69-90f9-83e0d42c212c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.043970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ee20af51-336a-4f69-90f9-83e0d42c212c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043583 Jul 27 20:30:58.044544 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 625/1212] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:58.184375 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d212506b-1614-4ee6-8aae-7266e6ebc641 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:58.184998 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d212506b-1614-4ee6-8aae-7266e6ebc641 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:58.191388 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d212506b-1614-4ee6-8aae-7266e6ebc641 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.191829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d212506b-1614-4ee6-8aae-7266e6ebc641 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.192608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d212506b-1614-4ee6-8aae-7266e6ebc641 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.193044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d212506b-1614-4ee6-8aae-7266e6ebc641 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.253246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d212506b-1614-4ee6-8aae-7266e6ebc641 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:58.260654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d212506b-1614-4ee6-8aae-7266e6ebc641 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079993 Jul 27 20:30:58.261163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 588/1213] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:59.056273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4fb2ea33-e9b2-484f-8edc-16a628dbb458 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:59.058453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4fb2ea33-e9b2-484f-8edc-16a628dbb458 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:59.064944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4fb2ea33-e9b2-484f-8edc-16a628dbb458 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.065386 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4fb2ea33-e9b2-484f-8edc-16a628dbb458 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.066137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4fb2ea33-e9b2-484f-8edc-16a628dbb458 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.066564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4fb2ea33-e9b2-484f-8edc-16a628dbb458 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.095098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4fb2ea33-e9b2-484f-8edc-16a628dbb458 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042815 Jul 27 20:30:59.095656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 626/1214] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:59 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:59.282303 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-83ff048f-e0d3-4278-bfd8-37f5af28bfdd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:59.282917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-83ff048f-e0d3-4278-bfd8-37f5af28bfdd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:59.285224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:59.289941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-83ff048f-e0d3-4278-bfd8-37f5af28bfdd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.290390 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-83ff048f-e0d3-4278-bfd8-37f5af28bfdd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.291169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-83ff048f-e0d3-4278-bfd8-37f5af28bfdd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.291600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-83ff048f-e0d3-4278-bfd8-37f5af28bfdd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.352329 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-83ff048f-e0d3-4278-bfd8-37f5af28bfdd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:59.360782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-83ff048f-e0d3-4278-bfd8-37f5af28bfdd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082798 Jul 27 20:30:59.361353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 589/1215] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:59 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:00.107281 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73b151c1-c60a-4fff-a6f6-966b09f5716f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:00.110033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-73b151c1-c60a-4fff-a6f6-966b09f5716f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:00.112310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=45 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:00.117311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73b151c1-c60a-4fff-a6f6-966b09f5716f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.117760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73b151c1-c60a-4fff-a6f6-966b09f5716f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.118509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73b151c1-c60a-4fff-a6f6-966b09f5716f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.118937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73b151c1-c60a-4fff-a6f6-966b09f5716f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.147637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-73b151c1-c60a-4fff-a6f6-966b09f5716f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044364 Jul 27 20:31:00.153818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 627/1216] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:00 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:00.383051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6107305b-2b89-42b6-9c6a-7599feb758c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:00.383779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6107305b-2b89-42b6-9c6a-7599feb758c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:00.390945 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6107305b-2b89-42b6-9c6a-7599feb758c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.391398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6107305b-2b89-42b6-9c6a-7599feb758c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.392161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6107305b-2b89-42b6-9c6a-7599feb758c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.392625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6107305b-2b89-42b6-9c6a-7599feb758c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.452368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6107305b-2b89-42b6-9c6a-7599feb758c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:00.459967 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6107305b-2b89-42b6-9c6a-7599feb758c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082032 Jul 27 20:31:00.460561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 590/1217] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:01.159918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ebc3c79b-bc53-453b-b0c7-604769edf527 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:01.162068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ebc3c79b-bc53-453b-b0c7-604769edf527 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:01.168791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ebc3c79b-bc53-453b-b0c7-604769edf527 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.169231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ebc3c79b-bc53-453b-b0c7-604769edf527 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.170506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ebc3c79b-bc53-453b-b0c7-604769edf527 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.170967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ebc3c79b-bc53-453b-b0c7-604769edf527 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.199301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ebc3c79b-bc53-453b-b0c7-604769edf527 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043375 Jul 27 20:31:01.199838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 628/1218] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:01.481148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-64448341-5462-4372-b215-339acbfcbf96 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:01.481766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-64448341-5462-4372-b215-339acbfcbf96 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:01.488821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64448341-5462-4372-b215-339acbfcbf96 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.489270 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64448341-5462-4372-b215-339acbfcbf96 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.490029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64448341-5462-4372-b215-339acbfcbf96 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.490464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64448341-5462-4372-b215-339acbfcbf96 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.553190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-64448341-5462-4372-b215-339acbfcbf96 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:01.560557 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-64448341-5462-4372-b215-339acbfcbf96 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083259 Jul 27 20:31:01.561119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 591/1219] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:01 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:02.211680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-48736513-aa28-479d-a510-767f3a47da50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:02.213819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-48736513-aa28-479d-a510-767f3a47da50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:02.220786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48736513-aa28-479d-a510-767f3a47da50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.221222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48736513-aa28-479d-a510-767f3a47da50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:02.221964 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48736513-aa28-479d-a510-767f3a47da50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.222386 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48736513-aa28-479d-a510-767f3a47da50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:02.251957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-48736513-aa28-479d-a510-767f3a47da50 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044365 Jul 27 20:31:02.252522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 629/1220] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:02 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:02.581726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cfc72288-b68f-4d4f-80e3-16d1396941f9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:02.582342 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cfc72288-b68f-4d4f-80e3-16d1396941f9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:02.588809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfc72288-b68f-4d4f-80e3-16d1396941f9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.589273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfc72288-b68f-4d4f-80e3-16d1396941f9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:02.590017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfc72288-b68f-4d4f-80e3-16d1396941f9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.590451 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfc72288-b68f-4d4f-80e3-16d1396941f9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:02.652404 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cfc72288-b68f-4d4f-80e3-16d1396941f9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:02.660486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cfc72288-b68f-4d4f-80e3-16d1396941f9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082599 Jul 27 20:31:02.664737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 592/1221] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:02 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:03.265033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6949bb8b-7be7-46d8-95ba-6ecce48b4cdc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:03.267167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6949bb8b-7be7-46d8-95ba-6ecce48b4cdc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:03.273817 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6949bb8b-7be7-46d8-95ba-6ecce48b4cdc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:03.274265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6949bb8b-7be7-46d8-95ba-6ecce48b4cdc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:03.275030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6949bb8b-7be7-46d8-95ba-6ecce48b4cdc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:03.275456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6949bb8b-7be7-46d8-95ba-6ecce48b4cdc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:03.305354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6949bb8b-7be7-46d8-95ba-6ecce48b4cdc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044918 Jul 27 20:31:03.305904 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 630/1222] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:03.684642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-19776181-b3fd-4c3b-bd56-9e9299c0d4a4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:03.685160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-19776181-b3fd-4c3b-bd56-9e9299c0d4a4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:03.691569 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19776181-b3fd-4c3b-bd56-9e9299c0d4a4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:03.692020 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19776181-b3fd-4c3b-bd56-9e9299c0d4a4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:03.692810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19776181-b3fd-4c3b-bd56-9e9299c0d4a4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:03.693248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19776181-b3fd-4c3b-bd56-9e9299c0d4a4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:03.752937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-19776181-b3fd-4c3b-bd56-9e9299c0d4a4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:03.760318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-19776181-b3fd-4c3b-bd56-9e9299c0d4a4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080719 Jul 27 20:31:03.760912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 593/1223] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:04.317883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-48b96d35-edc9-4653-be2f-41f20997f608 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:04.320018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-48b96d35-edc9-4653-be2f-41f20997f608 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:04.327148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48b96d35-edc9-4653-be2f-41f20997f608 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.327595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48b96d35-edc9-4653-be2f-41f20997f608 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.328351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48b96d35-edc9-4653-be2f-41f20997f608 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.328826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48b96d35-edc9-4653-be2f-41f20997f608 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.357565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-48b96d35-edc9-4653-be2f-41f20997f608 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043666 Jul 27 20:31:04.358132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 631/1224] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:04 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:04.782172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-91fb2cfd-ce07-4c90-881f-944e977574a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:04.782770 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-91fb2cfd-ce07-4c90-881f-944e977574a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:04.789514 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91fb2cfd-ce07-4c90-881f-944e977574a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.789963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91fb2cfd-ce07-4c90-881f-944e977574a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.790724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91fb2cfd-ce07-4c90-881f-944e977574a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.791156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91fb2cfd-ce07-4c90-881f-944e977574a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.851805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-91fb2cfd-ce07-4c90-881f-944e977574a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:04.859822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-91fb2cfd-ce07-4c90-881f-944e977574a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082185 Jul 27 20:31:04.860461 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 594/1225] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:05.370149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4e1efd08-a8ac-4927-957a-853ae358ebc0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:05.372271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4e1efd08-a8ac-4927-957a-853ae358ebc0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:05.378799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e1efd08-a8ac-4927-957a-853ae358ebc0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.379245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e1efd08-a8ac-4927-957a-853ae358ebc0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.379994 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e1efd08-a8ac-4927-957a-853ae358ebc0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.380455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e1efd08-a8ac-4927-957a-853ae358ebc0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.410177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4e1efd08-a8ac-4927-957a-853ae358ebc0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044248 Jul 27 20:31:05.410734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 632/1226] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:05 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:05.881547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-18bd4f05-88cd-468b-b5fa-adb8dd0552c3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:05.882163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-18bd4f05-88cd-468b-b5fa-adb8dd0552c3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:05.889360 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-18bd4f05-88cd-468b-b5fa-adb8dd0552c3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.889806 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-18bd4f05-88cd-468b-b5fa-adb8dd0552c3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.890563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-18bd4f05-88cd-468b-b5fa-adb8dd0552c3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.890999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-18bd4f05-88cd-468b-b5fa-adb8dd0552c3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.955354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-18bd4f05-88cd-468b-b5fa-adb8dd0552c3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:05.962846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-18bd4f05-88cd-468b-b5fa-adb8dd0552c3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085185 Jul 27 20:31:05.963416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 595/1227] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:06.422008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d8bb8461-b3e2-4269-98fc-97bf835a85f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:06.424148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d8bb8461-b3e2-4269-98fc-97bf835a85f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:06.430594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8bb8461-b3e2-4269-98fc-97bf835a85f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.431040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8bb8461-b3e2-4269-98fc-97bf835a85f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:06.431789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8bb8461-b3e2-4269-98fc-97bf835a85f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.432219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8bb8461-b3e2-4269-98fc-97bf835a85f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:06.460722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d8bb8461-b3e2-4269-98fc-97bf835a85f6 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042688 Jul 27 20:31:06.461254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 633/1228] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:06 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:06.983444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2e80ac54-2e7f-4929-89f6-8f8ad7820614 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:06.984054 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2e80ac54-2e7f-4929-89f6-8f8ad7820614 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:06.990474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e80ac54-2e7f-4929-89f6-8f8ad7820614 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.990921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e80ac54-2e7f-4929-89f6-8f8ad7820614 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:06.991665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e80ac54-2e7f-4929-89f6-8f8ad7820614 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.992092 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e80ac54-2e7f-4929-89f6-8f8ad7820614 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:07.051788 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2e80ac54-2e7f-4929-89f6-8f8ad7820614 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:07.059061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2e80ac54-2e7f-4929-89f6-8f8ad7820614 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079610 Jul 27 20:31:07.059622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 596/1229] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:07.473000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7fe77c9f-775a-49ae-b6da-7748c4aee996 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:07.475135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7fe77c9f-775a-49ae-b6da-7748c4aee996 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:07.481578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fe77c9f-775a-49ae-b6da-7748c4aee996 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:07.482025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fe77c9f-775a-49ae-b6da-7748c4aee996 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:07.482816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fe77c9f-775a-49ae-b6da-7748c4aee996 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:07.483253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fe77c9f-775a-49ae-b6da-7748c4aee996 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:07.512088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7fe77c9f-775a-49ae-b6da-7748c4aee996 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043083 Jul 27 20:31:07.512678 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 634/1230] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:07 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:08.080177 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-048c6916-4bcb-4754-9db4-a6f321c2604d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:08.080831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-048c6916-4bcb-4754-9db4-a6f321c2604d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:08.087264 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-048c6916-4bcb-4754-9db4-a6f321c2604d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.087718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-048c6916-4bcb-4754-9db4-a6f321c2604d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.088507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-048c6916-4bcb-4754-9db4-a6f321c2604d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.088946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-048c6916-4bcb-4754-9db4-a6f321c2604d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.148712 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-048c6916-4bcb-4754-9db4-a6f321c2604d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:08.156642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-048c6916-4bcb-4754-9db4-a6f321c2604d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080398 Jul 27 20:31:08.157207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 597/1231] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:08 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:08.524669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cc2c0158-ab28-49da-96d4-14dac52d7df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:08.526842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cc2c0158-ab28-49da-96d4-14dac52d7df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:08.533801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc2c0158-ab28-49da-96d4-14dac52d7df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.534265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc2c0158-ab28-49da-96d4-14dac52d7df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.535014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc2c0158-ab28-49da-96d4-14dac52d7df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.535441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc2c0158-ab28-49da-96d4-14dac52d7df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.563333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cc2c0158-ab28-49da-96d4-14dac52d7df4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042637 Jul 27 20:31:08.563883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 635/1232] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:08 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:09.177228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b70ebbae-3c69-4124-849f-05966fd89544 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:09.177833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b70ebbae-3c69-4124-849f-05966fd89544 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:09.184222 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b70ebbae-3c69-4124-849f-05966fd89544 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.184691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b70ebbae-3c69-4124-849f-05966fd89544 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.185457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b70ebbae-3c69-4124-849f-05966fd89544 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.185891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b70ebbae-3c69-4124-849f-05966fd89544 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.189724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:09.245880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b70ebbae-3c69-4124-849f-05966fd89544 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:09.253199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b70ebbae-3c69-4124-849f-05966fd89544 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079831 Jul 27 20:31:09.253765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 598/1233] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:09 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:09.575262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bc486ff9-3c4f-4bc1-9dfc-d75655029f71 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:09.577510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bc486ff9-3c4f-4bc1-9dfc-d75655029f71 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:09.583903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc486ff9-3c4f-4bc1-9dfc-d75655029f71 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.584350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc486ff9-3c4f-4bc1-9dfc-d75655029f71 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.585143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc486ff9-3c4f-4bc1-9dfc-d75655029f71 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.585576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc486ff9-3c4f-4bc1-9dfc-d75655029f71 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.614836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bc486ff9-3c4f-4bc1-9dfc-d75655029f71 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043636 Jul 27 20:31:09.615384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 636/1234] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:10.274280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7b898abc-a3ab-4734-96a4-a5aaf5ce8928 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:10.274899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7b898abc-a3ab-4734-96a4-a5aaf5ce8928 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:10.281377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b898abc-a3ab-4734-96a4-a5aaf5ce8928 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.281825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b898abc-a3ab-4734-96a4-a5aaf5ce8928 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.282588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b898abc-a3ab-4734-96a4-a5aaf5ce8928 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.283020 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b898abc-a3ab-4734-96a4-a5aaf5ce8928 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.347543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7b898abc-a3ab-4734-96a4-a5aaf5ce8928 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:10.355037 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7b898abc-a3ab-4734-96a4-a5aaf5ce8928 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084591 Jul 27 20:31:10.355600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 599/1235] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:10.627449 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7696d71f-4898-480e-b2ef-2084f3d914af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:10.629612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7696d71f-4898-480e-b2ef-2084f3d914af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:10.636001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7696d71f-4898-480e-b2ef-2084f3d914af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.636486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7696d71f-4898-480e-b2ef-2084f3d914af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.637264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7696d71f-4898-480e-b2ef-2084f3d914af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.637695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7696d71f-4898-480e-b2ef-2084f3d914af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.667773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7696d71f-4898-480e-b2ef-2084f3d914af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044411 Jul 27 20:31:10.668333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 637/1236] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:11.376563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8ba1c488-3551-4777-abef-37d1931efb88 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:11.377163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8ba1c488-3551-4777-abef-37d1931efb88 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:11.383740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ba1c488-3551-4777-abef-37d1931efb88 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.384192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ba1c488-3551-4777-abef-37d1931efb88 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.384989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ba1c488-3551-4777-abef-37d1931efb88 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.385523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ba1c488-3551-4777-abef-37d1931efb88 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.448692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ba1c488-3551-4777-abef-37d1931efb88 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:11.456640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8ba1c488-3551-4777-abef-37d1931efb88 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084375 Jul 27 20:31:11.457246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 600/1237] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:11.680342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9802c631-1762-4a78-befc-29c9b1b447a9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:11.682479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9802c631-1762-4a78-befc-29c9b1b447a9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:11.688903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9802c631-1762-4a78-befc-29c9b1b447a9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.689352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9802c631-1762-4a78-befc-29c9b1b447a9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.690106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9802c631-1762-4a78-befc-29c9b1b447a9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.690537 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9802c631-1762-4a78-befc-29c9b1b447a9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.706936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:11.720100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9802c631-1762-4a78-befc-29c9b1b447a9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043829 Jul 27 20:31:11.722698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 638/1238] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:11 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:12.477940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-caf028b0-232c-446c-ad4b-db1f0d724203 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:12.478556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-caf028b0-232c-446c-ad4b-db1f0d724203 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:12.485457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caf028b0-232c-446c-ad4b-db1f0d724203 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.485898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caf028b0-232c-446c-ad4b-db1f0d724203 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.486640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caf028b0-232c-446c-ad4b-db1f0d724203 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.487066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caf028b0-232c-446c-ad4b-db1f0d724203 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.547781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-caf028b0-232c-446c-ad4b-db1f0d724203 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:12.555058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-caf028b0-232c-446c-ad4b-db1f0d724203 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080981 Jul 27 20:31:12.555619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 601/1239] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:12.733631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5a69bd77-6e4f-4b80-b22e-5cb8cee953a0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:12.735740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5a69bd77-6e4f-4b80-b22e-5cb8cee953a0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:12.742261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a69bd77-6e4f-4b80-b22e-5cb8cee953a0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.745256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a69bd77-6e4f-4b80-b22e-5cb8cee953a0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.745256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a69bd77-6e4f-4b80-b22e-5cb8cee953a0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.745256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a69bd77-6e4f-4b80-b22e-5cb8cee953a0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.771924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5a69bd77-6e4f-4b80-b22e-5cb8cee953a0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043334 Jul 27 20:31:12.772503 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 639/1240] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:12 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:13.575516 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-da96cd62-0052-4548-b64b-108b3d38859e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:13.576125 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-da96cd62-0052-4548-b64b-108b3d38859e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:13.582807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da96cd62-0052-4548-b64b-108b3d38859e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.583262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da96cd62-0052-4548-b64b-108b3d38859e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:13.584034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da96cd62-0052-4548-b64b-108b3d38859e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.584517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da96cd62-0052-4548-b64b-108b3d38859e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:13.646700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-da96cd62-0052-4548-b64b-108b3d38859e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:13.653990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-da96cd62-0052-4548-b64b-108b3d38859e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082340 Jul 27 20:31:13.655218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 602/1241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:13.785273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f28c76b1-c1a0-4d4f-bf09-c4ba27035ff9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:13.787598 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f28c76b1-c1a0-4d4f-bf09-c4ba27035ff9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:13.794196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f28c76b1-c1a0-4d4f-bf09-c4ba27035ff9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.794644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f28c76b1-c1a0-4d4f-bf09-c4ba27035ff9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:13.795549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f28c76b1-c1a0-4d4f-bf09-c4ba27035ff9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.795981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f28c76b1-c1a0-4d4f-bf09-c4ba27035ff9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:13.825898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f28c76b1-c1a0-4d4f-bf09-c4ba27035ff9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044699 Jul 27 20:31:13.826992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 640/1242] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:13 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:14.675437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a026afda-2c3f-4ec0-9f1f-46ed5d82a13a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:14.676033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a026afda-2c3f-4ec0-9f1f-46ed5d82a13a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:14.682248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a026afda-2c3f-4ec0-9f1f-46ed5d82a13a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:14.682702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a026afda-2c3f-4ec0-9f1f-46ed5d82a13a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:14.683460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a026afda-2c3f-4ec0-9f1f-46ed5d82a13a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:14.683899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a026afda-2c3f-4ec0-9f1f-46ed5d82a13a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:14.746208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a026afda-2c3f-4ec0-9f1f-46ed5d82a13a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:14.754095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a026afda-2c3f-4ec0-9f1f-46ed5d82a13a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082906 Jul 27 20:31:14.754665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 603/1243] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:14.838644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b6edcd7b-c143-47a9-8a0f-3c6c908de945 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:14.840835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b6edcd7b-c143-47a9-8a0f-3c6c908de945 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:14.847169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6edcd7b-c143-47a9-8a0f-3c6c908de945 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:14.847611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6edcd7b-c143-47a9-8a0f-3c6c908de945 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:14.848361 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6edcd7b-c143-47a9-8a0f-3c6c908de945 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:14.848813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6edcd7b-c143-47a9-8a0f-3c6c908de945 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:14.877550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b6edcd7b-c143-47a9-8a0f-3c6c908de945 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042876 Jul 27 20:31:14.878094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 641/1244] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:14 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:15.775305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a318e6e8-8c29-4e6b-88e2-76610d41b1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:15.775918 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a318e6e8-8c29-4e6b-88e2-76610d41b1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:15.782926 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a318e6e8-8c29-4e6b-88e2-76610d41b1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:15.783376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a318e6e8-8c29-4e6b-88e2-76610d41b1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:15.784133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a318e6e8-8c29-4e6b-88e2-76610d41b1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:15.784603 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a318e6e8-8c29-4e6b-88e2-76610d41b1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:15.844301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a318e6e8-8c29-4e6b-88e2-76610d41b1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:15.851712 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a318e6e8-8c29-4e6b-88e2-76610d41b1db tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080252 Jul 27 20:31:15.852279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 604/1245] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:15 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:15.890243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8dd0532b-e3aa-4564-803b-4f61401b783d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:15.892422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8dd0532b-e3aa-4564-803b-4f61401b783d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:15.898843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dd0532b-e3aa-4564-803b-4f61401b783d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:15.899288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dd0532b-e3aa-4564-803b-4f61401b783d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:15.900049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dd0532b-e3aa-4564-803b-4f61401b783d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:15.900517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dd0532b-e3aa-4564-803b-4f61401b783d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:15.929228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8dd0532b-e3aa-4564-803b-4f61401b783d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043465 Jul 27 20:31:15.929779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 642/1246] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:16.873707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d40299f6-a612-4f3a-ad77-c5dc17e0853c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:16.874313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d40299f6-a612-4f3a-ad77-c5dc17e0853c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:16.880802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d40299f6-a612-4f3a-ad77-c5dc17e0853c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:16.881250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d40299f6-a612-4f3a-ad77-c5dc17e0853c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:16.882004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d40299f6-a612-4f3a-ad77-c5dc17e0853c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:16.882437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d40299f6-a612-4f3a-ad77-c5dc17e0853c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:16.941938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d40299f6-a612-4f3a-ad77-c5dc17e0853c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:16.942102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d0f3fd72-abb6-4915-b69c-75d6a1730be9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:16.944237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d0f3fd72-abb6-4915-b69c-75d6a1730be9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:16.949501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d40299f6-a612-4f3a-ad77-c5dc17e0853c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080268 Jul 27 20:31:16.950195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 605/1247] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:16.950590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0f3fd72-abb6-4915-b69c-75d6a1730be9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:16.951047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0f3fd72-abb6-4915-b69c-75d6a1730be9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:16.951813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0f3fd72-abb6-4915-b69c-75d6a1730be9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:16.952250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0f3fd72-abb6-4915-b69c-75d6a1730be9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:16.980608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d0f3fd72-abb6-4915-b69c-75d6a1730be9 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042485 Jul 27 20:31:16.981166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 643/1248] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:16 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:31:17.970251 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e3cd830a-3fcc-4bc2-8e92-910cfe799606 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:17.970865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e3cd830a-3fcc-4bc2-8e92-910cfe799606 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:17.977344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3cd830a-3fcc-4bc2-8e92-910cfe799606 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.977798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3cd830a-3fcc-4bc2-8e92-910cfe799606 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.978556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3cd830a-3fcc-4bc2-8e92-910cfe799606 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.978993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3cd830a-3fcc-4bc2-8e92-910cfe799606 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.993506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0e7f78e8-bbff-4875-9cb1-89db4952047a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:17.995635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0e7f78e8-bbff-4875-9cb1-89db4952047a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:18.003845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e7f78e8-bbff-4875-9cb1-89db4952047a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:18.004359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e7f78e8-bbff-4875-9cb1-89db4952047a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:18.005481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e7f78e8-bbff-4875-9cb1-89db4952047a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:18.006579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e7f78e8-bbff-4875-9cb1-89db4952047a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:18.036791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0e7f78e8-bbff-4875-9cb1-89db4952047a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047233 Jul 27 20:31:18.037361 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 644/1249] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:31:18.044210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e3cd830a-3fcc-4bc2-8e92-910cfe799606 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:18.051737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e3cd830a-3fcc-4bc2-8e92-910cfe799606 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085505 Jul 27 20:31:18.052302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 606/1250] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:19.072283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4c0fe327-1cdf-490f-86a4-a46d2e6fbda2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:19.077456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4c0fe327-1cdf-490f-86a4-a46d2e6fbda2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:19.079933 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c0fe327-1cdf-490f-86a4-a46d2e6fbda2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:19.080401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c0fe327-1cdf-490f-86a4-a46d2e6fbda2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:19.081161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c0fe327-1cdf-490f-86a4-a46d2e6fbda2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:19.081594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c0fe327-1cdf-490f-86a4-a46d2e6fbda2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:19.147113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4c0fe327-1cdf-490f-86a4-a46d2e6fbda2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:19.154549 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4c0fe327-1cdf-490f-86a4-a46d2e6fbda2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.086136 Jul 27 20:31:19.155146 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 607/1251] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:19.168818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3af0fdcb-3b6b-46b4-95e0-90bed0fce954 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:19.171098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3af0fdcb-3b6b-46b4-95e0-90bed0fce954 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:19.177065 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3af0fdcb-3b6b-46b4-95e0-90bed0fce954 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:19.177510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3af0fdcb-3b6b-46b4-95e0-90bed0fce954 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:19.178269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3af0fdcb-3b6b-46b4-95e0-90bed0fce954 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:19.178705 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3af0fdcb-3b6b-46b4-95e0-90bed0fce954 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:19.207270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3af0fdcb-3b6b-46b4-95e0-90bed0fce954 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161839 Jul 27 20:31:19.207756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 645/1252] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:19 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:31:20.176659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b82ef314-8709-444c-8d1c-dfce58f78a1a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:20.177213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b82ef314-8709-444c-8d1c-dfce58f78a1a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:20.184569 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b82ef314-8709-444c-8d1c-dfce58f78a1a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:20.185014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b82ef314-8709-444c-8d1c-dfce58f78a1a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:20.185773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b82ef314-8709-444c-8d1c-dfce58f78a1a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:20.186515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b82ef314-8709-444c-8d1c-dfce58f78a1a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:20.219743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8c139449-5d11-4637-8f82-4485631b5cab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:20.221920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8c139449-5d11-4637-8f82-4485631b5cab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:20.228491 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c139449-5d11-4637-8f82-4485631b5cab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:20.229173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c139449-5d11-4637-8f82-4485631b5cab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:20.229943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c139449-5d11-4637-8f82-4485631b5cab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:20.230377 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c139449-5d11-4637-8f82-4485631b5cab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:20.246913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b82ef314-8709-444c-8d1c-dfce58f78a1a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:20.254417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b82ef314-8709-444c-8d1c-dfce58f78a1a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081812 Jul 27 20:31:20.255192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 608/1253] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:20.260489 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8c139449-5d11-4637-8f82-4485631b5cab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045141 Jul 27 20:31:20.261050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 646/1254] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:20 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:31:21.272979 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-848b57b5-9790-4a0b-8436-d5e4fca74f1d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:21.274737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a79e6f9c-0760-45a6-a123-244c3a3b19d1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:21.275150 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-848b57b5-9790-4a0b-8436-d5e4fca74f1d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:21.275380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a79e6f9c-0760-45a6-a123-244c3a3b19d1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:21.282336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-848b57b5-9790-4a0b-8436-d5e4fca74f1d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:21.282493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a79e6f9c-0760-45a6-a123-244c3a3b19d1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:21.282781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-848b57b5-9790-4a0b-8436-d5e4fca74f1d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:21.282900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a79e6f9c-0760-45a6-a123-244c3a3b19d1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:21.283543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-848b57b5-9790-4a0b-8436-d5e4fca74f1d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:21.283641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a79e6f9c-0760-45a6-a123-244c3a3b19d1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:21.283981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-848b57b5-9790-4a0b-8436-d5e4fca74f1d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:21.284100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a79e6f9c-0760-45a6-a123-244c3a3b19d1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:21.312398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-848b57b5-9790-4a0b-8436-d5e4fca74f1d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043452 Jul 27 20:31:21.312966 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 609/1255] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:21.345968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a79e6f9c-0760-45a6-a123-244c3a3b19d1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:21.353506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a79e6f9c-0760-45a6-a123-244c3a3b19d1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082556 Jul 27 20:31:21.354080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 647/1256] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:22.324197 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c499a129-5e51-4417-a098-1a2b3d3e4ca7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:22.326337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c499a129-5e51-4417-a098-1a2b3d3e4ca7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:22.333558 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c499a129-5e51-4417-a098-1a2b3d3e4ca7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:22.334005 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c499a129-5e51-4417-a098-1a2b3d3e4ca7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:22.334799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c499a129-5e51-4417-a098-1a2b3d3e4ca7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:22.335201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c499a129-5e51-4417-a098-1a2b3d3e4ca7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:22.363460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c499a129-5e51-4417-a098-1a2b3d3e4ca7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043257 Jul 27 20:31:22.364012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 610/1257] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:22.374709 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-62ddf07e-a9df-4a22-a52d-7db01055a3c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:22.375343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-62ddf07e-a9df-4a22-a52d-7db01055a3c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:22.381793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-62ddf07e-a9df-4a22-a52d-7db01055a3c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:22.382241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-62ddf07e-a9df-4a22-a52d-7db01055a3c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:22.382998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-62ddf07e-a9df-4a22-a52d-7db01055a3c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:22.383434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-62ddf07e-a9df-4a22-a52d-7db01055a3c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:22.442947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-62ddf07e-a9df-4a22-a52d-7db01055a3c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:22.450390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-62ddf07e-a9df-4a22-a52d-7db01055a3c1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080132 Jul 27 20:31:22.450955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 648/1258] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:23.376053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-66417e8e-8e8b-4489-b2d1-0f017e601cf2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:23.378219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-66417e8e-8e8b-4489-b2d1-0f017e601cf2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:23.384669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-66417e8e-8e8b-4489-b2d1-0f017e601cf2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:23.385122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-66417e8e-8e8b-4489-b2d1-0f017e601cf2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:23.385879 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-66417e8e-8e8b-4489-b2d1-0f017e601cf2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:23.386316 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-66417e8e-8e8b-4489-b2d1-0f017e601cf2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:23.415645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-66417e8e-8e8b-4489-b2d1-0f017e601cf2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043656 Jul 27 20:31:23.416229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 611/1259] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:23 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:23.471608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3911c0b5-4b1a-4360-a081-525b9d732cf3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:23.472223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3911c0b5-4b1a-4360-a081-525b9d732cf3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:23.478731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3911c0b5-4b1a-4360-a081-525b9d732cf3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:23.479172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3911c0b5-4b1a-4360-a081-525b9d732cf3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:23.479927 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3911c0b5-4b1a-4360-a081-525b9d732cf3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:23.480362 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3911c0b5-4b1a-4360-a081-525b9d732cf3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:23.544406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3911c0b5-4b1a-4360-a081-525b9d732cf3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:23.551803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3911c0b5-4b1a-4360-a081-525b9d732cf3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084675 Jul 27 20:31:23.552400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 649/1260] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:24.427289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8b0e916d-1160-46fa-bfc7-9cbd5d10f9eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:24.429455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8b0e916d-1160-46fa-bfc7-9cbd5d10f9eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:24.435876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b0e916d-1160-46fa-bfc7-9cbd5d10f9eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:24.436333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b0e916d-1160-46fa-bfc7-9cbd5d10f9eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:24.437125 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b0e916d-1160-46fa-bfc7-9cbd5d10f9eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:24.437562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b0e916d-1160-46fa-bfc7-9cbd5d10f9eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:24.466825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8b0e916d-1160-46fa-bfc7-9cbd5d10f9eb tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043492 Jul 27 20:31:24.467385 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 612/1261] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:24 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:24.572191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a6fff8ff-9bba-4d86-b245-d716d42951ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:24.572831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a6fff8ff-9bba-4d86-b245-d716d42951ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:24.579196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6fff8ff-9bba-4d86-b245-d716d42951ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:24.579639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6fff8ff-9bba-4d86-b245-d716d42951ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:24.580404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6fff8ff-9bba-4d86-b245-d716d42951ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:24.580847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6fff8ff-9bba-4d86-b245-d716d42951ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:24.640664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a6fff8ff-9bba-4d86-b245-d716d42951ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:24.647978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a6fff8ff-9bba-4d86-b245-d716d42951ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079580 Jul 27 20:31:24.648573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 650/1262] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:25.479285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a0ce8dc8-6844-4289-8678-f5a7e9933f18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:25.481468 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a0ce8dc8-6844-4289-8678-f5a7e9933f18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:25.487905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0ce8dc8-6844-4289-8678-f5a7e9933f18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:25.488357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0ce8dc8-6844-4289-8678-f5a7e9933f18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:25.489156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0ce8dc8-6844-4289-8678-f5a7e9933f18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:25.489593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0ce8dc8-6844-4289-8678-f5a7e9933f18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:25.519309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a0ce8dc8-6844-4289-8678-f5a7e9933f18 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044084 Jul 27 20:31:25.519854 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 613/1263] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:25 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:25.669192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ba2c64f7-3661-4107-a6b8-d1ce2c73b780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:25.669822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ba2c64f7-3661-4107-a6b8-d1ce2c73b780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:25.675919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba2c64f7-3661-4107-a6b8-d1ce2c73b780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:25.676357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba2c64f7-3661-4107-a6b8-d1ce2c73b780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:25.677127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba2c64f7-3661-4107-a6b8-d1ce2c73b780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:25.677552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba2c64f7-3661-4107-a6b8-d1ce2c73b780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:25.736596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ba2c64f7-3661-4107-a6b8-d1ce2c73b780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:25.744079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ba2c64f7-3661-4107-a6b8-d1ce2c73b780 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.078776 Jul 27 20:31:25.744679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 651/1264] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:26.531619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b07dc21c-aec5-4442-bc56-4c6cdfc43d93 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:26.534384 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b07dc21c-aec5-4442-bc56-4c6cdfc43d93 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:26.540821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b07dc21c-aec5-4442-bc56-4c6cdfc43d93 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:26.541261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b07dc21c-aec5-4442-bc56-4c6cdfc43d93 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:26.542006 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b07dc21c-aec5-4442-bc56-4c6cdfc43d93 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:26.542432 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b07dc21c-aec5-4442-bc56-4c6cdfc43d93 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:26.567728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:26.572056 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b07dc21c-aec5-4442-bc56-4c6cdfc43d93 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044437 Jul 27 20:31:26.572626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 614/1265] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:26 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:26.764704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-79b91ae7-2fe4-4c11-845a-fff295f4f019 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:26.765311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-79b91ae7-2fe4-4c11-845a-fff295f4f019 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:26.772426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79b91ae7-2fe4-4c11-845a-fff295f4f019 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:26.772877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79b91ae7-2fe4-4c11-845a-fff295f4f019 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:26.773634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79b91ae7-2fe4-4c11-845a-fff295f4f019 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:26.774067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79b91ae7-2fe4-4c11-845a-fff295f4f019 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:26.833756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-79b91ae7-2fe4-4c11-845a-fff295f4f019 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:26.841125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-79b91ae7-2fe4-4c11-845a-fff295f4f019 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080264 Jul 27 20:31:26.841689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 652/1266] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:27.584877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-51d3ee77-d9d7-4a9e-b647-dc42cae56b02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:27.587031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-51d3ee77-d9d7-4a9e-b647-dc42cae56b02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:27.593654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51d3ee77-d9d7-4a9e-b647-dc42cae56b02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:27.594044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51d3ee77-d9d7-4a9e-b647-dc42cae56b02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:27.595285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51d3ee77-d9d7-4a9e-b647-dc42cae56b02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:27.595717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51d3ee77-d9d7-4a9e-b647-dc42cae56b02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:27.624981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-51d3ee77-d9d7-4a9e-b647-dc42cae56b02 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044524 Jul 27 20:31:27.625537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 615/1267] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:27 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:27.861753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b6f90d9c-81b3-4b76-83b1-0aa62a45ef11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:27.862290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b6f90d9c-81b3-4b76-83b1-0aa62a45ef11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:27.868977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6f90d9c-81b3-4b76-83b1-0aa62a45ef11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:27.869419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6f90d9c-81b3-4b76-83b1-0aa62a45ef11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:27.870161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6f90d9c-81b3-4b76-83b1-0aa62a45ef11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:27.870588 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6f90d9c-81b3-4b76-83b1-0aa62a45ef11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:27.934317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b6f90d9c-81b3-4b76-83b1-0aa62a45ef11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:27.941729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b6f90d9c-81b3-4b76-83b1-0aa62a45ef11 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084024 Jul 27 20:31:27.942295 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 653/1268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:27 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:28.651922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-77424d18-df5a-4f45-91b1-cee92f9afded tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:28.654077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-77424d18-df5a-4f45-91b1-cee92f9afded tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:28.661141 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77424d18-df5a-4f45-91b1-cee92f9afded tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:28.661593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77424d18-df5a-4f45-91b1-cee92f9afded tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:28.662347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77424d18-df5a-4f45-91b1-cee92f9afded tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:28.662780 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77424d18-df5a-4f45-91b1-cee92f9afded tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:28.690867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-77424d18-df5a-4f45-91b1-cee92f9afded tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042987 Jul 27 20:31:28.691420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 616/1269] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:28 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:28.963222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-09d03b4a-5c46-491d-a742-6ab6e57fb075 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:28.963755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-09d03b4a-5c46-491d-a742-6ab6e57fb075 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:28.970258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09d03b4a-5c46-491d-a742-6ab6e57fb075 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:28.970707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09d03b4a-5c46-491d-a742-6ab6e57fb075 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:28.971461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09d03b4a-5c46-491d-a742-6ab6e57fb075 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:28.971893 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09d03b4a-5c46-491d-a742-6ab6e57fb075 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:29.032708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-09d03b4a-5c46-491d-a742-6ab6e57fb075 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:29.040083 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-09d03b4a-5c46-491d-a742-6ab6e57fb075 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080824 Jul 27 20:31:29.040685 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 654/1270] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:29.703236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f3cea61d-780b-4d92-a46c-2bb2430413ff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:29.705909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f3cea61d-780b-4d92-a46c-2bb2430413ff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:29.708159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=56 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:29.712836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3cea61d-780b-4d92-a46c-2bb2430413ff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:29.713279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3cea61d-780b-4d92-a46c-2bb2430413ff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:29.714026 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3cea61d-780b-4d92-a46c-2bb2430413ff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:29.714455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3cea61d-780b-4d92-a46c-2bb2430413ff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:29.742540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f3cea61d-780b-4d92-a46c-2bb2430413ff tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043403 Jul 27 20:31:29.743348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 617/1271] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:29 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:30.063844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0fd4423b-fca5-46dc-a33b-ee29f672833b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:30.064472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0fd4423b-fca5-46dc-a33b-ee29f672833b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:30.070935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0fd4423b-fca5-46dc-a33b-ee29f672833b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:30.071378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0fd4423b-fca5-46dc-a33b-ee29f672833b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:30.072123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0fd4423b-fca5-46dc-a33b-ee29f672833b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:30.072586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0fd4423b-fca5-46dc-a33b-ee29f672833b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:30.076396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:30.134895 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0fd4423b-fca5-46dc-a33b-ee29f672833b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:30.142581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0fd4423b-fca5-46dc-a33b-ee29f672833b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082636 Jul 27 20:31:30.143149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 655/1272] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:30.755702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0bb73616-3ed2-4229-8b28-668e775bc57b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:30.757862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0bb73616-3ed2-4229-8b28-668e775bc57b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:30.764142 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0bb73616-3ed2-4229-8b28-668e775bc57b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:30.764609 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0bb73616-3ed2-4229-8b28-668e775bc57b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:30.765348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0bb73616-3ed2-4229-8b28-668e775bc57b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:30.765774 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0bb73616-3ed2-4229-8b28-668e775bc57b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:30.793862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0bb73616-3ed2-4229-8b28-668e775bc57b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042464 Jul 27 20:31:30.794404 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 618/1273] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:31.163615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-16debd5f-19c5-41ff-bde0-7067cb3b4aaf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:31.164153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-16debd5f-19c5-41ff-bde0-7067cb3b4aaf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:31.166392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=58 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:31.171062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-16debd5f-19c5-41ff-bde0-7067cb3b4aaf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:31.171501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-16debd5f-19c5-41ff-bde0-7067cb3b4aaf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:31.172275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-16debd5f-19c5-41ff-bde0-7067cb3b4aaf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:31.172738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-16debd5f-19c5-41ff-bde0-7067cb3b4aaf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:31.234100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-16debd5f-19c5-41ff-bde0-7067cb3b4aaf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:31.241464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-16debd5f-19c5-41ff-bde0-7067cb3b4aaf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081743 Jul 27 20:31:31.242026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 656/1274] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:31.806790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-630c0429-d31e-4e6b-8ec9-c4ad0bc59ffa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:31.808928 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-630c0429-d31e-4e6b-8ec9-c4ad0bc59ffa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:31.815994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-630c0429-d31e-4e6b-8ec9-c4ad0bc59ffa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:31.816460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-630c0429-d31e-4e6b-8ec9-c4ad0bc59ffa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:31.817206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-630c0429-d31e-4e6b-8ec9-c4ad0bc59ffa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:31.817634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-630c0429-d31e-4e6b-8ec9-c4ad0bc59ffa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:31.845514 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-630c0429-d31e-4e6b-8ec9-c4ad0bc59ffa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042656 Jul 27 20:31:31.846055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 619/1275] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:31 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:32.262875 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-99e9f2de-65e4-478f-a4e4-68a286a5498f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:32.263484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-99e9f2de-65e4-478f-a4e4-68a286a5498f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:32.269889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99e9f2de-65e4-478f-a4e4-68a286a5498f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:32.270330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99e9f2de-65e4-478f-a4e4-68a286a5498f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:32.271077 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99e9f2de-65e4-478f-a4e4-68a286a5498f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:32.271504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99e9f2de-65e4-478f-a4e4-68a286a5498f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:32.487611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-99e9f2de-65e4-478f-a4e4-68a286a5498f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:32.495318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-99e9f2de-65e4-478f-a4e4-68a286a5498f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.236394 Jul 27 20:31:32.495881 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 657/1276] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:32.857568 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0e5c9e2e-9e27-4361-b187-02bcd1f06126 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:32.859594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0e5c9e2e-9e27-4361-b187-02bcd1f06126 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:32.866141 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e5c9e2e-9e27-4361-b187-02bcd1f06126 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:32.866581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e5c9e2e-9e27-4361-b187-02bcd1f06126 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:32.867330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e5c9e2e-9e27-4361-b187-02bcd1f06126 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:32.868020 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e5c9e2e-9e27-4361-b187-02bcd1f06126 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:32.897539 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0e5c9e2e-9e27-4361-b187-02bcd1f06126 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044052 Jul 27 20:31:32.898082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 620/1277] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:32 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:33.514997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e5fc6728-8d79-495e-8664-2916f4350314 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:33.515643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e5fc6728-8d79-495e-8664-2916f4350314 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:33.522974 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e5fc6728-8d79-495e-8664-2916f4350314 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:33.523423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e5fc6728-8d79-495e-8664-2916f4350314 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:33.524173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e5fc6728-8d79-495e-8664-2916f4350314 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:33.524634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e5fc6728-8d79-495e-8664-2916f4350314 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:33.627802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e5fc6728-8d79-495e-8664-2916f4350314 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:33.635178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e5fc6728-8d79-495e-8664-2916f4350314 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.124043 Jul 27 20:31:33.635738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 658/1278] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:33 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:33.910519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d751ba64-3e7c-419f-ae85-b6113d28db8d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:33.912692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d751ba64-3e7c-419f-ae85-b6113d28db8d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:33.919055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d751ba64-3e7c-419f-ae85-b6113d28db8d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:33.919490 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d751ba64-3e7c-419f-ae85-b6113d28db8d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:33.920263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d751ba64-3e7c-419f-ae85-b6113d28db8d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:33.920723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d751ba64-3e7c-419f-ae85-b6113d28db8d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:33.949768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d751ba64-3e7c-419f-ae85-b6113d28db8d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043856 Jul 27 20:31:33.950331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 621/1279] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:33 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:34.655269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-55a703df-1f31-43c0-a546-dddec04a1f22 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:34.655872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-55a703df-1f31-43c0-a546-dddec04a1f22 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:34.663140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55a703df-1f31-43c0-a546-dddec04a1f22 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:34.663660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55a703df-1f31-43c0-a546-dddec04a1f22 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:34.664438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55a703df-1f31-43c0-a546-dddec04a1f22 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:34.664868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-55a703df-1f31-43c0-a546-dddec04a1f22 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:34.725490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-55a703df-1f31-43c0-a546-dddec04a1f22 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:34.732893 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-55a703df-1f31-43c0-a546-dddec04a1f22 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081578 Jul 27 20:31:34.733456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 659/1280] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:34.962686 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-084c6400-a781-4b33-84ea-bdbcd11577c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:34.964831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-084c6400-a781-4b33-84ea-bdbcd11577c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:34.971274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-084c6400-a781-4b33-84ea-bdbcd11577c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:34.971722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-084c6400-a781-4b33-84ea-bdbcd11577c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:34.972502 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-084c6400-a781-4b33-84ea-bdbcd11577c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:34.972941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-084c6400-a781-4b33-84ea-bdbcd11577c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:35.003256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-084c6400-a781-4b33-84ea-bdbcd11577c4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044640 Jul 27 20:31:35.003804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 622/1281] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:35.755353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4e0b4eda-b0de-48bb-9ba0-4f05e6fd80cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:35.755960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4e0b4eda-b0de-48bb-9ba0-4f05e6fd80cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:35.762389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e0b4eda-b0de-48bb-9ba0-4f05e6fd80cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:35.762831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e0b4eda-b0de-48bb-9ba0-4f05e6fd80cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:35.763589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e0b4eda-b0de-48bb-9ba0-4f05e6fd80cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:35.764014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e0b4eda-b0de-48bb-9ba0-4f05e6fd80cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:35.827082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4e0b4eda-b0de-48bb-9ba0-4f05e6fd80cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:35.835150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4e0b4eda-b0de-48bb-9ba0-4f05e6fd80cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083708 Jul 27 20:31:35.835700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 660/1282] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:35 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:36.014931 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-11e1c136-3021-4c5e-be91-5b186c7e74d4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:36.017620 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-11e1c136-3021-4c5e-be91-5b186c7e74d4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:36.024527 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11e1c136-3021-4c5e-be91-5b186c7e74d4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:36.024976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11e1c136-3021-4c5e-be91-5b186c7e74d4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:36.025730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11e1c136-3021-4c5e-be91-5b186c7e74d4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:36.026164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11e1c136-3021-4c5e-be91-5b186c7e74d4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:36.056581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-11e1c136-3021-4c5e-be91-5b186c7e74d4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045703 Jul 27 20:31:36.057180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 623/1283] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:36 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:36.855752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-42fafc27-2a15-47f0-9718-74cf41cdca63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:36.856365 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-42fafc27-2a15-47f0-9718-74cf41cdca63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:36.862905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42fafc27-2a15-47f0-9718-74cf41cdca63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:36.863353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42fafc27-2a15-47f0-9718-74cf41cdca63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:36.864102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42fafc27-2a15-47f0-9718-74cf41cdca63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:36.864576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42fafc27-2a15-47f0-9718-74cf41cdca63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:36.928292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-42fafc27-2a15-47f0-9718-74cf41cdca63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:36.935681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-42fafc27-2a15-47f0-9718-74cf41cdca63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083787 Jul 27 20:31:36.936230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 661/1284] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:37.067921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0a8376ee-9be2-4956-8966-a9689842ace4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:37.070096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0a8376ee-9be2-4956-8966-a9689842ace4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:37.076607 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a8376ee-9be2-4956-8966-a9689842ace4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:37.077056 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a8376ee-9be2-4956-8966-a9689842ace4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:37.077821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a8376ee-9be2-4956-8966-a9689842ace4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:37.078256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a8376ee-9be2-4956-8966-a9689842ace4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:37.107584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0a8376ee-9be2-4956-8966-a9689842ace4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043542 Jul 27 20:31:37.108048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 624/1285] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:37.957682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f26e58fa-1ed1-4e7c-9385-946abf93566d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:37.958278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f26e58fa-1ed1-4e7c-9385-946abf93566d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:37.964727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f26e58fa-1ed1-4e7c-9385-946abf93566d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:37.965174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f26e58fa-1ed1-4e7c-9385-946abf93566d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:37.965921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f26e58fa-1ed1-4e7c-9385-946abf93566d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:37.966351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f26e58fa-1ed1-4e7c-9385-946abf93566d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:38.025766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f26e58fa-1ed1-4e7c-9385-946abf93566d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:38.033699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f26e58fa-1ed1-4e7c-9385-946abf93566d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081127 Jul 27 20:31:38.034257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 662/1286] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:38.119991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-13ec3d09-27ea-4189-9a2c-6f3400b42cfd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:38.122180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-13ec3d09-27ea-4189-9a2c-6f3400b42cfd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:38.128642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13ec3d09-27ea-4189-9a2c-6f3400b42cfd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:38.129089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13ec3d09-27ea-4189-9a2c-6f3400b42cfd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:38.129841 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13ec3d09-27ea-4189-9a2c-6f3400b42cfd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:38.130277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13ec3d09-27ea-4189-9a2c-6f3400b42cfd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:38.158736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-13ec3d09-27ea-4189-9a2c-6f3400b42cfd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043021 Jul 27 20:31:38.159283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 625/1287] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:38 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:39.170962 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-98ebdb71-d570-4d79-906e-b9a8ea45d467 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:39.173124 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-98ebdb71-d570-4d79-906e-b9a8ea45d467 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:39.177863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-91e50ed8-971b-425b-aca2-d3849bef2f38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:39.178479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-91e50ed8-971b-425b-aca2-d3849bef2f38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:39.179571 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98ebdb71-d570-4d79-906e-b9a8ea45d467 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:39.180027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98ebdb71-d570-4d79-906e-b9a8ea45d467 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:39.180823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98ebdb71-d570-4d79-906e-b9a8ea45d467 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:39.181261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-98ebdb71-d570-4d79-906e-b9a8ea45d467 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:39.184650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91e50ed8-971b-425b-aca2-d3849bef2f38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:39.185169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91e50ed8-971b-425b-aca2-d3849bef2f38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:39.185997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91e50ed8-971b-425b-aca2-d3849bef2f38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:39.186458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91e50ed8-971b-425b-aca2-d3849bef2f38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:39.210244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-98ebdb71-d570-4d79-906e-b9a8ea45d467 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043185 Jul 27 20:31:39.210813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 626/1288] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:39 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:31:39.248404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91e50ed8-971b-425b-aca2-d3849bef2f38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:39.255848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-91e50ed8-971b-425b-aca2-d3849bef2f38 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.205767 Jul 27 20:31:39.256424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 663/1289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:40.223029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-da9758a0-6b3a-40fa-a6fc-64f602bb35e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:40.225233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-da9758a0-6b3a-40fa-a6fc-64f602bb35e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:40.231792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da9758a0-6b3a-40fa-a6fc-64f602bb35e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:40.232100 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da9758a0-6b3a-40fa-a6fc-64f602bb35e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:40.232888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da9758a0-6b3a-40fa-a6fc-64f602bb35e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:40.233328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da9758a0-6b3a-40fa-a6fc-64f602bb35e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:40.269215 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-da9758a0-6b3a-40fa-a6fc-64f602bb35e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050168 Jul 27 20:31:40.269786 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 627/1290] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:40 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:40.276549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b9ead9c2-de53-4117-ade1-ec65d900afd8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:40.277167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b9ead9c2-de53-4117-ade1-ec65d900afd8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:40.283481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b9ead9c2-de53-4117-ade1-ec65d900afd8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:40.283933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b9ead9c2-de53-4117-ade1-ec65d900afd8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:40.284723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b9ead9c2-de53-4117-ade1-ec65d900afd8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:40.285158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b9ead9c2-de53-4117-ade1-ec65d900afd8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:40.348030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b9ead9c2-de53-4117-ade1-ec65d900afd8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:40.355489 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b9ead9c2-de53-4117-ade1-ec65d900afd8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082772 Jul 27 20:31:40.356055 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 664/1291] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:40 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:41.281034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3d7c5e28-bc51-4982-865f-5f7784849759 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:41.283645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3d7c5e28-bc51-4982-865f-5f7784849759 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:41.290050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d7c5e28-bc51-4982-865f-5f7784849759 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:41.290496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d7c5e28-bc51-4982-865f-5f7784849759 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:41.291247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d7c5e28-bc51-4982-865f-5f7784849759 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:41.291677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d7c5e28-bc51-4982-865f-5f7784849759 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:41.320176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3d7c5e28-bc51-4982-865f-5f7784849759 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043123 Jul 27 20:31:41.320745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 628/1292] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:41 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:41.377601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ff7b14ba-e76c-4b10-be0f-ba29963f4af0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:41.378203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ff7b14ba-e76c-4b10-be0f-ba29963f4af0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:41.384689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff7b14ba-e76c-4b10-be0f-ba29963f4af0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:41.385131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff7b14ba-e76c-4b10-be0f-ba29963f4af0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:41.385879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff7b14ba-e76c-4b10-be0f-ba29963f4af0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:41.386301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff7b14ba-e76c-4b10-be0f-ba29963f4af0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:41.445775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ff7b14ba-e76c-4b10-be0f-ba29963f4af0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:41.453088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ff7b14ba-e76c-4b10-be0f-ba29963f4af0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080168 Jul 27 20:31:41.454205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 665/1293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:41 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:42.332632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d5524d47-ef51-4fbb-9851-6eeee5168dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:42.334755 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d5524d47-ef51-4fbb-9851-6eeee5168dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:42.341233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5524d47-ef51-4fbb-9851-6eeee5168dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:42.341654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5524d47-ef51-4fbb-9851-6eeee5168dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:42.342430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5524d47-ef51-4fbb-9851-6eeee5168dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:42.342855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5524d47-ef51-4fbb-9851-6eeee5168dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:42.371907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d5524d47-ef51-4fbb-9851-6eeee5168dd5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043836 Jul 27 20:31:42.372477 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 629/1294] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:42 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:42.474153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ca74c9a3-94f2-412a-adc6-25dbdafb4f49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:42.474752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ca74c9a3-94f2-412a-adc6-25dbdafb4f49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:42.481208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca74c9a3-94f2-412a-adc6-25dbdafb4f49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:42.481656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca74c9a3-94f2-412a-adc6-25dbdafb4f49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:42.482476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca74c9a3-94f2-412a-adc6-25dbdafb4f49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:42.482847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca74c9a3-94f2-412a-adc6-25dbdafb4f49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:42.543792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ca74c9a3-94f2-412a-adc6-25dbdafb4f49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:42.551287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ca74c9a3-94f2-412a-adc6-25dbdafb4f49 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080973 Jul 27 20:31:42.551860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 666/1295] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:43.383862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-991d5652-61be-495d-ba5b-83777def8e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:43.386072 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-991d5652-61be-495d-ba5b-83777def8e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:43.393435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-991d5652-61be-495d-ba5b-83777def8e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:43.393878 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-991d5652-61be-495d-ba5b-83777def8e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:43.394662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-991d5652-61be-495d-ba5b-83777def8e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:43.395096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-991d5652-61be-495d-ba5b-83777def8e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:43.423665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-991d5652-61be-495d-ba5b-83777def8e86 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043807 Jul 27 20:31:43.424208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 630/1296] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:43 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:43.573006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-36f7c506-f973-483c-b315-c10f635d9e36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:43.573619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-36f7c506-f973-483c-b315-c10f635d9e36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:43.580091 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36f7c506-f973-483c-b315-c10f635d9e36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:43.580577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36f7c506-f973-483c-b315-c10f635d9e36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:43.581329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36f7c506-f973-483c-b315-c10f635d9e36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:43.581759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36f7c506-f973-483c-b315-c10f635d9e36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:43.641060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-36f7c506-f973-483c-b315-c10f635d9e36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:43.648350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-36f7c506-f973-483c-b315-c10f635d9e36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079186 Jul 27 20:31:43.648935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 667/1297] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:43 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:44.436129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-807b2fa8-2ea9-4e7d-afb1-4b1bf29b3212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:44.438328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-807b2fa8-2ea9-4e7d-afb1-4b1bf29b3212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:44.444303 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-807b2fa8-2ea9-4e7d-afb1-4b1bf29b3212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:44.444808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-807b2fa8-2ea9-4e7d-afb1-4b1bf29b3212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:44.445558 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-807b2fa8-2ea9-4e7d-afb1-4b1bf29b3212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:44.446000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-807b2fa8-2ea9-4e7d-afb1-4b1bf29b3212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:44.462458 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:44.475451 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-807b2fa8-2ea9-4e7d-afb1-4b1bf29b3212 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043520 Jul 27 20:31:44.476005 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 631/1298] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:44 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:44.669016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a3b38b34-13ab-45f6-9574-3053a2ac92b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:44.669547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a3b38b34-13ab-45f6-9574-3053a2ac92b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:44.675923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3b38b34-13ab-45f6-9574-3053a2ac92b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:44.676368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3b38b34-13ab-45f6-9574-3053a2ac92b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:44.677149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3b38b34-13ab-45f6-9574-3053a2ac92b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:44.677611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3b38b34-13ab-45f6-9574-3053a2ac92b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:44.739405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3b38b34-13ab-45f6-9574-3053a2ac92b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:44.747065 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a3b38b34-13ab-45f6-9574-3053a2ac92b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082010 Jul 27 20:31:44.747626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 668/1299] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:45.488172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a4cf58d5-2a73-48f0-9f32-dc3898418e2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:45.490357 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a4cf58d5-2a73-48f0-9f32-dc3898418e2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:45.497023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4cf58d5-2a73-48f0-9f32-dc3898418e2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:45.497465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4cf58d5-2a73-48f0-9f32-dc3898418e2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:45.498209 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4cf58d5-2a73-48f0-9f32-dc3898418e2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:45.498638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4cf58d5-2a73-48f0-9f32-dc3898418e2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:45.526503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a4cf58d5-2a73-48f0-9f32-dc3898418e2c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043281 Jul 27 20:31:45.527038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 632/1300] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:45 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:45.768297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-15c6c1df-1a94-47d5-a2de-95a6686c9a31 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:45.768859 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-15c6c1df-1a94-47d5-a2de-95a6686c9a31 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:45.775506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15c6c1df-1a94-47d5-a2de-95a6686c9a31 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:45.775963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15c6c1df-1a94-47d5-a2de-95a6686c9a31 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:45.776752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15c6c1df-1a94-47d5-a2de-95a6686c9a31 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:45.777183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15c6c1df-1a94-47d5-a2de-95a6686c9a31 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:45.840406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-15c6c1df-1a94-47d5-a2de-95a6686c9a31 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:45.848527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-15c6c1df-1a94-47d5-a2de-95a6686c9a31 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084607 Jul 27 20:31:45.849085 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 669/1301] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:46.538924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-64d08cd8-2af5-40b3-9b35-2d181b7a707a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:46.541086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-64d08cd8-2af5-40b3-9b35-2d181b7a707a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:46.548018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64d08cd8-2af5-40b3-9b35-2d181b7a707a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:46.548546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64d08cd8-2af5-40b3-9b35-2d181b7a707a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:46.549319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64d08cd8-2af5-40b3-9b35-2d181b7a707a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:46.549751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64d08cd8-2af5-40b3-9b35-2d181b7a707a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:46.579682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-64d08cd8-2af5-40b3-9b35-2d181b7a707a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044818 Jul 27 20:31:46.580236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 633/1302] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:46 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:31:46.869435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a3f7e5f0-7356-412e-93a4-c11b591f5c9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:46.869973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a3f7e5f0-7356-412e-93a4-c11b591f5c9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:46.877182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3f7e5f0-7356-412e-93a4-c11b591f5c9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:46.877633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3f7e5f0-7356-412e-93a4-c11b591f5c9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:46.878391 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3f7e5f0-7356-412e-93a4-c11b591f5c9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:46.878827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3f7e5f0-7356-412e-93a4-c11b591f5c9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:46.937745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3f7e5f0-7356-412e-93a4-c11b591f5c9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:46.945148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a3f7e5f0-7356-412e-93a4-c11b591f5c9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079939 Jul 27 20:31:46.945723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 670/1303] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:47.592459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3ec2f504-52d0-46fa-8993-4e6efe1e48f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:47.595139 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3ec2f504-52d0-46fa-8993-4e6efe1e48f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:47.601627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ec2f504-52d0-46fa-8993-4e6efe1e48f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:47.602077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ec2f504-52d0-46fa-8993-4e6efe1e48f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:47.602857 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ec2f504-52d0-46fa-8993-4e6efe1e48f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:47.603295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ec2f504-52d0-46fa-8993-4e6efe1e48f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:47.631693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3ec2f504-52d0-46fa-8993-4e6efe1e48f7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043354 Jul 27 20:31:47.632250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 634/1304] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:47 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:47.966936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ef381a67-8463-4de6-adb7-f4ff69519f7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:47.967468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ef381a67-8463-4de6-adb7-f4ff69519f7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:47.974494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef381a67-8463-4de6-adb7-f4ff69519f7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:47.974944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef381a67-8463-4de6-adb7-f4ff69519f7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:47.975701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef381a67-8463-4de6-adb7-f4ff69519f7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:47.976135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef381a67-8463-4de6-adb7-f4ff69519f7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:48.037003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ef381a67-8463-4de6-adb7-f4ff69519f7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:48.042309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:48.047076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ef381a67-8463-4de6-adb7-f4ff69519f7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083964 Jul 27 20:31:48.048216 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 671/1305] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:47 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:48.644185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be136a86-ff28-4692-bd80-cdf403c23079 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:48.646302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-be136a86-ff28-4692-bd80-cdf403c23079 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:48.652737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be136a86-ff28-4692-bd80-cdf403c23079 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:48.653189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be136a86-ff28-4692-bd80-cdf403c23079 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:48.653947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be136a86-ff28-4692-bd80-cdf403c23079 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:48.654381 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be136a86-ff28-4692-bd80-cdf403c23079 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:48.683681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-be136a86-ff28-4692-bd80-cdf403c23079 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043595 Jul 27 20:31:48.684229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 635/1306] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:48 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:49.067957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-772f8f41-4a93-4c7e-b4cf-9e9543734777 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:49.071976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-772f8f41-4a93-4c7e-b4cf-9e9543734777 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:49.075632 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-772f8f41-4a93-4c7e-b4cf-9e9543734777 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:49.076073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-772f8f41-4a93-4c7e-b4cf-9e9543734777 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:49.076847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-772f8f41-4a93-4c7e-b4cf-9e9543734777 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:49.077271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-772f8f41-4a93-4c7e-b4cf-9e9543734777 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:49.140122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-772f8f41-4a93-4c7e-b4cf-9e9543734777 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:49.148024 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-772f8f41-4a93-4c7e-b4cf-9e9543734777 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084424 Jul 27 20:31:49.148615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 672/1307] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:49.695989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-80cde9a9-59df-492b-a137-96ce1283e8e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:49.698229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-80cde9a9-59df-492b-a137-96ce1283e8e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:49.704604 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80cde9a9-59df-492b-a137-96ce1283e8e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:49.705045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80cde9a9-59df-492b-a137-96ce1283e8e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:49.705789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80cde9a9-59df-492b-a137-96ce1283e8e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:49.706220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80cde9a9-59df-492b-a137-96ce1283e8e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:49.733994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-80cde9a9-59df-492b-a137-96ce1283e8e0 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042051 Jul 27 20:31:49.734538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 636/1308] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:49 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:50.169488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5742ca62-40e1-48ed-864c-cd5d326957b1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:50.170146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5742ca62-40e1-48ed-864c-cd5d326957b1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:50.177204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5742ca62-40e1-48ed-864c-cd5d326957b1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:50.177645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5742ca62-40e1-48ed-864c-cd5d326957b1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:50.178395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5742ca62-40e1-48ed-864c-cd5d326957b1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:50.178821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5742ca62-40e1-48ed-864c-cd5d326957b1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:50.237874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5742ca62-40e1-48ed-864c-cd5d326957b1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:50.245570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5742ca62-40e1-48ed-864c-cd5d326957b1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079930 Jul 27 20:31:50.246131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 673/1309] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:50.747178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-748b738c-ca1b-41f7-9140-2cf5c4cc6def tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:50.749330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-748b738c-ca1b-41f7-9140-2cf5c4cc6def tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:50.756347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-748b738c-ca1b-41f7-9140-2cf5c4cc6def tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:50.756815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-748b738c-ca1b-41f7-9140-2cf5c4cc6def tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:50.757552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-748b738c-ca1b-41f7-9140-2cf5c4cc6def tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:50.757974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-748b738c-ca1b-41f7-9140-2cf5c4cc6def tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:50.786413 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-748b738c-ca1b-41f7-9140-2cf5c4cc6def tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043474 Jul 27 20:31:50.786890 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 637/1310] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:50 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:51.267312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9bfe2839-9308-403e-a41f-d98b98d2735a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:51.267927 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9bfe2839-9308-403e-a41f-d98b98d2735a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:51.275083 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bfe2839-9308-403e-a41f-d98b98d2735a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:51.275527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bfe2839-9308-403e-a41f-d98b98d2735a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:51.277134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bfe2839-9308-403e-a41f-d98b98d2735a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:51.277581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bfe2839-9308-403e-a41f-d98b98d2735a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:51.337352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9bfe2839-9308-403e-a41f-d98b98d2735a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:51.344950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9bfe2839-9308-403e-a41f-d98b98d2735a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081522 Jul 27 20:31:51.345511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 674/1311] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:51.799201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ad48ff9b-d995-4dc4-b6cf-81835c28f42a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:51.801440 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ad48ff9b-d995-4dc4-b6cf-81835c28f42a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:51.807997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad48ff9b-d995-4dc4-b6cf-81835c28f42a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:51.808543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad48ff9b-d995-4dc4-b6cf-81835c28f42a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:51.809295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad48ff9b-d995-4dc4-b6cf-81835c28f42a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:51.809725 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad48ff9b-d995-4dc4-b6cf-81835c28f42a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:51.838109 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ad48ff9b-d995-4dc4-b6cf-81835c28f42a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043516 Jul 27 20:31:51.838630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 638/1312] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:51 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:52.366005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-58d07692-aa1c-4e25-a567-51142b391266 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:52.366609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-58d07692-aa1c-4e25-a567-51142b391266 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:52.373285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58d07692-aa1c-4e25-a567-51142b391266 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:52.373724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58d07692-aa1c-4e25-a567-51142b391266 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:52.374466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58d07692-aa1c-4e25-a567-51142b391266 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:52.374887 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58d07692-aa1c-4e25-a567-51142b391266 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:52.434363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-58d07692-aa1c-4e25-a567-51142b391266 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:52.442694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-58d07692-aa1c-4e25-a567-51142b391266 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080563 Jul 27 20:31:52.443273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 675/1313] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:52.850468 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f8bd92e4-cde5-41c2-8f7b-2ad73cc945bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:52.852624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f8bd92e4-cde5-41c2-8f7b-2ad73cc945bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:52.858956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8bd92e4-cde5-41c2-8f7b-2ad73cc945bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:52.859403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8bd92e4-cde5-41c2-8f7b-2ad73cc945bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:52.860675 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8bd92e4-cde5-41c2-8f7b-2ad73cc945bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:52.861104 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8bd92e4-cde5-41c2-8f7b-2ad73cc945bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:52.889701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f8bd92e4-cde5-41c2-8f7b-2ad73cc945bc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043271 Jul 27 20:31:52.890245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 639/1314] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:52 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:53.463852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-54531850-611b-40a5-a3b2-3d6ea0f0e91a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:53.464502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-54531850-611b-40a5-a3b2-3d6ea0f0e91a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:53.471487 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54531850-611b-40a5-a3b2-3d6ea0f0e91a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:53.471928 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54531850-611b-40a5-a3b2-3d6ea0f0e91a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:53.472712 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54531850-611b-40a5-a3b2-3d6ea0f0e91a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:53.473142 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54531850-611b-40a5-a3b2-3d6ea0f0e91a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:53.537171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-54531850-611b-40a5-a3b2-3d6ea0f0e91a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:53.542767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:31:53.543102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:31:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa (ip 10.222.0.47) !!! Jul 27 20:31:53.544959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-54531850-611b-40a5-a3b2-3d6ea0f0e91a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084927 Jul 27 20:31:53.546196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 676/1315] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:53.902080 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e2561dfe-b886-4386-921c-27825e07507c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:53.904219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e2561dfe-b886-4386-921c-27825e07507c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:53.911128 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2561dfe-b886-4386-921c-27825e07507c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:53.911584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2561dfe-b886-4386-921c-27825e07507c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:53.912349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2561dfe-b886-4386-921c-27825e07507c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:53.912824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2561dfe-b886-4386-921c-27825e07507c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:53.941479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e2561dfe-b886-4386-921c-27825e07507c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043408 Jul 27 20:31:53.942024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 640/1316] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:53 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:54.566095 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e06fd5df-80fa-449f-a1ee-c627fecdca10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:54.566653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e06fd5df-80fa-449f-a1ee-c627fecdca10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:54.573189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e06fd5df-80fa-449f-a1ee-c627fecdca10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:54.573633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e06fd5df-80fa-449f-a1ee-c627fecdca10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:54.574388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e06fd5df-80fa-449f-a1ee-c627fecdca10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:54.574831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e06fd5df-80fa-449f-a1ee-c627fecdca10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:54.634701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e06fd5df-80fa-449f-a1ee-c627fecdca10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:54.642126 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e06fd5df-80fa-449f-a1ee-c627fecdca10 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079984 Jul 27 20:31:54.642691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 677/1317] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:54 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:54.954324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d11c7bd2-ff9f-4b85-84bf-a59d6c947dde tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:54.956435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d11c7bd2-ff9f-4b85-84bf-a59d6c947dde tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:54.962866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d11c7bd2-ff9f-4b85-84bf-a59d6c947dde tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:54.963314 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d11c7bd2-ff9f-4b85-84bf-a59d6c947dde tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:54.964069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d11c7bd2-ff9f-4b85-84bf-a59d6c947dde tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:54.964551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d11c7bd2-ff9f-4b85-84bf-a59d6c947dde tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:54.993908 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d11c7bd2-ff9f-4b85-84bf-a59d6c947dde tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043959 Jul 27 20:31:54.994460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 641/1318] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:54 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:55.662905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9443bd22-0161-4367-85cd-6972cc255b41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:55.663461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9443bd22-0161-4367-85cd-6972cc255b41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:55.669528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9443bd22-0161-4367-85cd-6972cc255b41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:55.669981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9443bd22-0161-4367-85cd-6972cc255b41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:55.670736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9443bd22-0161-4367-85cd-6972cc255b41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:55.671169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9443bd22-0161-4367-85cd-6972cc255b41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:55.731277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9443bd22-0161-4367-85cd-6972cc255b41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:55.739176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9443bd22-0161-4367-85cd-6972cc255b41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080404 Jul 27 20:31:55.739737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 678/1319] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:56.006276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fd1ac9e1-7896-42ab-81e9-c64800b6396a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:56.008496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fd1ac9e1-7896-42ab-81e9-c64800b6396a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:56.014865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd1ac9e1-7896-42ab-81e9-c64800b6396a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:56.015300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd1ac9e1-7896-42ab-81e9-c64800b6396a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:56.016070 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd1ac9e1-7896-42ab-81e9-c64800b6396a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:56.016534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd1ac9e1-7896-42ab-81e9-c64800b6396a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:56.044977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fd1ac9e1-7896-42ab-81e9-c64800b6396a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042672 Jul 27 20:31:56.045520 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 642/1320] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:56 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:56.761057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-827c853a-018a-4c2d-818b-5638ebfc632a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:56.761668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-827c853a-018a-4c2d-818b-5638ebfc632a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:56.768153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-827c853a-018a-4c2d-818b-5638ebfc632a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:56.768703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-827c853a-018a-4c2d-818b-5638ebfc632a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:56.769461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-827c853a-018a-4c2d-818b-5638ebfc632a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:56.769896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-827c853a-018a-4c2d-818b-5638ebfc632a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:56.829250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-827c853a-018a-4c2d-818b-5638ebfc632a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:56.836764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-827c853a-018a-4c2d-818b-5638ebfc632a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079647 Jul 27 20:31:56.837327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 679/1321] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:57.057926 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8e24c322-cc05-4eeb-8347-f7b7fa51efbd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:57.060034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8e24c322-cc05-4eeb-8347-f7b7fa51efbd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:57.066566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e24c322-cc05-4eeb-8347-f7b7fa51efbd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:57.067016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e24c322-cc05-4eeb-8347-f7b7fa51efbd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:57.067772 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e24c322-cc05-4eeb-8347-f7b7fa51efbd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:57.068211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e24c322-cc05-4eeb-8347-f7b7fa51efbd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:57.098203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8e24c322-cc05-4eeb-8347-f7b7fa51efbd tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044332 Jul 27 20:31:57.098752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 643/1322] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:57 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:57.857819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ffebe306-9776-4063-b03d-b0dba4c2b4a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:57.858423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ffebe306-9776-4063-b03d-b0dba4c2b4a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:57.865576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ffebe306-9776-4063-b03d-b0dba4c2b4a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:57.866019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ffebe306-9776-4063-b03d-b0dba4c2b4a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:57.866766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ffebe306-9776-4063-b03d-b0dba4c2b4a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:57.867195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ffebe306-9776-4063-b03d-b0dba4c2b4a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:57.929662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ffebe306-9776-4063-b03d-b0dba4c2b4a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:57.937053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ffebe306-9776-4063-b03d-b0dba4c2b4a0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083192 Jul 27 20:31:57.937619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 680/1323] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:58.110973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c94d6b3d-5c4e-4ab3-b47b-26cd18710a61 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:58.113037 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c94d6b3d-5c4e-4ab3-b47b-26cd18710a61 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:58.120715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c94d6b3d-5c4e-4ab3-b47b-26cd18710a61 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:58.121154 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c94d6b3d-5c4e-4ab3-b47b-26cd18710a61 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:58.121915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c94d6b3d-5c4e-4ab3-b47b-26cd18710a61 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:58.122322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c94d6b3d-5c4e-4ab3-b47b-26cd18710a61 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:58.150831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c94d6b3d-5c4e-4ab3-b47b-26cd18710a61 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044441 Jul 27 20:31:58.151372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 644/1324] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:58 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:58.958802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-33e87911-de5f-4c6e-a103-2ee51c363630 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:58.959448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-33e87911-de5f-4c6e-a103-2ee51c363630 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:58.966006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33e87911-de5f-4c6e-a103-2ee51c363630 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:58.966453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33e87911-de5f-4c6e-a103-2ee51c363630 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:58.967210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33e87911-de5f-4c6e-a103-2ee51c363630 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:58.967647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33e87911-de5f-4c6e-a103-2ee51c363630 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:59.027715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-33e87911-de5f-4c6e-a103-2ee51c363630 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:59.035134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-33e87911-de5f-4c6e-a103-2ee51c363630 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080158 Jul 27 20:31:59.035700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 681/1325] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:59.163070 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8a64bab9-ad3f-4cec-b32e-648e2f41df95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:59.165295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8a64bab9-ad3f-4cec-b32e-648e2f41df95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:59.171696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a64bab9-ad3f-4cec-b32e-648e2f41df95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:59.172149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a64bab9-ad3f-4cec-b32e-648e2f41df95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:59.172940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a64bab9-ad3f-4cec-b32e-648e2f41df95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:59.173482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a64bab9-ad3f-4cec-b32e-648e2f41df95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:59.201817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8a64bab9-ad3f-4cec-b32e-648e2f41df95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042710 Jul 27 20:31:59.202364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 645/1326] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:59 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:00.055755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-25f24125-edf7-46e1-ba7c-731b564d615c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:00.056366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-25f24125-edf7-46e1-ba7c-731b564d615c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:00.062873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25f24125-edf7-46e1-ba7c-731b564d615c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:00.063327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25f24125-edf7-46e1-ba7c-731b564d615c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:00.064082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25f24125-edf7-46e1-ba7c-731b564d615c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:00.064567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25f24125-edf7-46e1-ba7c-731b564d615c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:00.124290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-25f24125-edf7-46e1-ba7c-731b564d615c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:00.131730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-25f24125-edf7-46e1-ba7c-731b564d615c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079862 Jul 27 20:32:00.132292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 682/1327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:00.214560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-775e7db6-5a86-436e-af55-54e7173d5fbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:00.216798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-775e7db6-5a86-436e-af55-54e7173d5fbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:00.223721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-775e7db6-5a86-436e-af55-54e7173d5fbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:00.224164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-775e7db6-5a86-436e-af55-54e7173d5fbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:00.224943 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-775e7db6-5a86-436e-af55-54e7173d5fbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:00.225370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-775e7db6-5a86-436e-af55-54e7173d5fbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:00.254008 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-775e7db6-5a86-436e-af55-54e7173d5fbc tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043332 Jul 27 20:32:00.254565 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 646/1328] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:00 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:01.152677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2b74fd24-e61b-4467-8898-a40cefa0c886 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:01.153258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2b74fd24-e61b-4467-8898-a40cefa0c886 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:01.160194 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b74fd24-e61b-4467-8898-a40cefa0c886 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:01.160659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b74fd24-e61b-4467-8898-a40cefa0c886 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:01.161405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b74fd24-e61b-4467-8898-a40cefa0c886 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:01.161830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b74fd24-e61b-4467-8898-a40cefa0c886 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:01.222628 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2b74fd24-e61b-4467-8898-a40cefa0c886 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:01.229836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2b74fd24-e61b-4467-8898-a40cefa0c886 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080976 Jul 27 20:32:01.230402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 683/1329] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:01 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:01.265778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d7edd94e-3cd8-4ee9-9cee-54fa796b7c29 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:01.268817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d7edd94e-3cd8-4ee9-9cee-54fa796b7c29 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:01.272145 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=60 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:01.276978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7edd94e-3cd8-4ee9-9cee-54fa796b7c29 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:01.277434 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7edd94e-3cd8-4ee9-9cee-54fa796b7c29 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:01.278200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7edd94e-3cd8-4ee9-9cee-54fa796b7c29 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:01.278633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7edd94e-3cd8-4ee9-9cee-54fa796b7c29 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:01.306817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d7edd94e-3cd8-4ee9-9cee-54fa796b7c29 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045107 Jul 27 20:32:01.307380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 647/1330] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:01 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:02.250496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a4bd73e1-e658-4ab5-b9c8-303f576eaf3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:02.251110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a4bd73e1-e658-4ab5-b9c8-303f576eaf3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:02.254017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=56 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:02.258768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4bd73e1-e658-4ab5-b9c8-303f576eaf3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:02.259217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4bd73e1-e658-4ab5-b9c8-303f576eaf3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:02.259976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4bd73e1-e658-4ab5-b9c8-303f576eaf3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:02.260427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4bd73e1-e658-4ab5-b9c8-303f576eaf3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:02.319301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e27d65ba-abcb-419c-abb6-fb873d7b3232 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:02.321931 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e27d65ba-abcb-419c-abb6-fb873d7b3232 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:02.323916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a4bd73e1-e658-4ab5-b9c8-303f576eaf3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:02.328907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e27d65ba-abcb-419c-abb6-fb873d7b3232 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:02.329365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e27d65ba-abcb-419c-abb6-fb873d7b3232 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:02.330133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e27d65ba-abcb-419c-abb6-fb873d7b3232 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:02.330570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e27d65ba-abcb-419c-abb6-fb873d7b3232 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:02.331923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a4bd73e1-e658-4ab5-b9c8-303f576eaf3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085261 Jul 27 20:32:02.332723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 684/1331] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:02 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:02.335447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:02.360810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e27d65ba-abcb-419c-abb6-fb873d7b3232 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045470 Jul 27 20:32:02.368776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 648/1332] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:02 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:32:03.353610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6dbbcbfe-76f0-4e0d-aa4d-2b9cb70af73c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:03.354221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6dbbcbfe-76f0-4e0d-aa4d-2b9cb70af73c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:03.361280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6dbbcbfe-76f0-4e0d-aa4d-2b9cb70af73c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:03.361722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6dbbcbfe-76f0-4e0d-aa4d-2b9cb70af73c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:03.362468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6dbbcbfe-76f0-4e0d-aa4d-2b9cb70af73c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:03.362895 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6dbbcbfe-76f0-4e0d-aa4d-2b9cb70af73c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:03.379211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9a36a752-7262-4ce3-9cac-03bfa5b2308c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:03.381380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9a36a752-7262-4ce3-9cac-03bfa5b2308c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:03.387877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a36a752-7262-4ce3-9cac-03bfa5b2308c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:03.388328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a36a752-7262-4ce3-9cac-03bfa5b2308c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:03.389185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a36a752-7262-4ce3-9cac-03bfa5b2308c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:03.389655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a36a752-7262-4ce3-9cac-03bfa5b2308c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:03.419331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9a36a752-7262-4ce3-9cac-03bfa5b2308c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045011 Jul 27 20:32:03.419895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 649/1333] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:03 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:32:03.424135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6dbbcbfe-76f0-4e0d-aa4d-2b9cb70af73c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:03.431727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6dbbcbfe-76f0-4e0d-aa4d-2b9cb70af73c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082022 Jul 27 20:32:03.432282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 685/1334] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:04.432538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fd7be68f-18db-4b9c-a917-2c944c43f0a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:04.434719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fd7be68f-18db-4b9c-a917-2c944c43f0a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:04.441891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd7be68f-18db-4b9c-a917-2c944c43f0a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:04.442339 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd7be68f-18db-4b9c-a917-2c944c43f0a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:04.443096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd7be68f-18db-4b9c-a917-2c944c43f0a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:04.443532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd7be68f-18db-4b9c-a917-2c944c43f0a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:04.452136 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-37ebef29-644f-491f-af5e-c9bcd4cfee4b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:04.452781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-37ebef29-644f-491f-af5e-c9bcd4cfee4b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:04.459758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-37ebef29-644f-491f-af5e-c9bcd4cfee4b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:04.460211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-37ebef29-644f-491f-af5e-c9bcd4cfee4b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:04.461009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-37ebef29-644f-491f-af5e-c9bcd4cfee4b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:04.461460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-37ebef29-644f-491f-af5e-c9bcd4cfee4b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:04.473219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fd7be68f-18db-4b9c-a917-2c944c43f0a3 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044735 Jul 27 20:32:04.473809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 650/1335] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:04 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:04.521571 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-37ebef29-644f-491f-af5e-c9bcd4cfee4b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:04.529019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-37ebef29-644f-491f-af5e-c9bcd4cfee4b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080703 Jul 27 20:32:04.529586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 686/1336] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:32:05.485495 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2ff0d0bd-f69e-4594-9d3b-94718e3e4071 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:05.487639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2ff0d0bd-f69e-4594-9d3b-94718e3e4071 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:05.494306 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ff0d0bd-f69e-4594-9d3b-94718e3e4071 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:05.494755 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ff0d0bd-f69e-4594-9d3b-94718e3e4071 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:05.495506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ff0d0bd-f69e-4594-9d3b-94718e3e4071 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:05.495937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ff0d0bd-f69e-4594-9d3b-94718e3e4071 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:05.524688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2ff0d0bd-f69e-4594-9d3b-94718e3e4071 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043201 Jul 27 20:32:05.525233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 651/1337] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:05 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:05.549772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-65a85671-e267-4bcc-a384-f63472ec2599 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:05.550385 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-65a85671-e267-4bcc-a384-f63472ec2599 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:05.556956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65a85671-e267-4bcc-a384-f63472ec2599 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:05.557408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65a85671-e267-4bcc-a384-f63472ec2599 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:05.558165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65a85671-e267-4bcc-a384-f63472ec2599 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:05.558601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65a85671-e267-4bcc-a384-f63472ec2599 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:05.618141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-65a85671-e267-4bcc-a384-f63472ec2599 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:05.625786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-65a85671-e267-4bcc-a384-f63472ec2599 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079868 Jul 27 20:32:05.626356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 687/1338] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:06.537221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d2e619b8-b702-4945-94fe-9e367b9886af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:06.539302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d2e619b8-b702-4945-94fe-9e367b9886af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:06.545767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2e619b8-b702-4945-94fe-9e367b9886af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:06.546214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2e619b8-b702-4945-94fe-9e367b9886af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:06.546969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2e619b8-b702-4945-94fe-9e367b9886af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:06.547406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2e619b8-b702-4945-94fe-9e367b9886af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:06.575976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d2e619b8-b702-4945-94fe-9e367b9886af tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042931 Jul 27 20:32:06.576554 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 652/1339] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:06 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:06.650684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a8755c76-e044-4c9d-bbc6-1a7e0117f818 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:06.651366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a8755c76-e044-4c9d-bbc6-1a7e0117f818 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:06.658005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8755c76-e044-4c9d-bbc6-1a7e0117f818 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:06.658446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8755c76-e044-4c9d-bbc6-1a7e0117f818 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:06.659190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8755c76-e044-4c9d-bbc6-1a7e0117f818 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:06.659611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8755c76-e044-4c9d-bbc6-1a7e0117f818 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:06.676730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:06.722530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a8755c76-e044-4c9d-bbc6-1a7e0117f818 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:06.729745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a8755c76-e044-4c9d-bbc6-1a7e0117f818 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083352 Jul 27 20:32:06.730309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 688/1340] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:07.588866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7fcb194d-f3a2-4928-8b77-997ef10b7ade tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:07.591051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7fcb194d-f3a2-4928-8b77-997ef10b7ade tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:07.598090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fcb194d-f3a2-4928-8b77-997ef10b7ade tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:07.598526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fcb194d-f3a2-4928-8b77-997ef10b7ade tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:07.599273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fcb194d-f3a2-4928-8b77-997ef10b7ade tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:07.599702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fcb194d-f3a2-4928-8b77-997ef10b7ade tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:07.630263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7fcb194d-f3a2-4928-8b77-997ef10b7ade tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045375 Jul 27 20:32:07.630824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 653/1341] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:07 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:07.750250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1e7eab07-3b00-4473-94bd-56ec09ba6329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:07.750839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1e7eab07-3b00-4473-94bd-56ec09ba6329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:07.757299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1e7eab07-3b00-4473-94bd-56ec09ba6329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:07.757736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1e7eab07-3b00-4473-94bd-56ec09ba6329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:07.758480 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1e7eab07-3b00-4473-94bd-56ec09ba6329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:07.758909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1e7eab07-3b00-4473-94bd-56ec09ba6329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:07.829470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1e7eab07-3b00-4473-94bd-56ec09ba6329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:07.836729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1e7eab07-3b00-4473-94bd-56ec09ba6329 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.090387 Jul 27 20:32:07.837287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 689/1342] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:08.643102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-03576098-57d3-4bd2-a34a-547f38309399 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:08.645198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-03576098-57d3-4bd2-a34a-547f38309399 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:08.651559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-03576098-57d3-4bd2-a34a-547f38309399 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:08.652012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-03576098-57d3-4bd2-a34a-547f38309399 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:08.652805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-03576098-57d3-4bd2-a34a-547f38309399 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:08.653248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-03576098-57d3-4bd2-a34a-547f38309399 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:08.682662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-03576098-57d3-4bd2-a34a-547f38309399 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044046 Jul 27 20:32:08.683203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 654/1343] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:08 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:08.857832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-31efb498-54de-4ddb-93ad-a94aae203114 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:08.858441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-31efb498-54de-4ddb-93ad-a94aae203114 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:08.865717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31efb498-54de-4ddb-93ad-a94aae203114 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:08.866159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31efb498-54de-4ddb-93ad-a94aae203114 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:08.866906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31efb498-54de-4ddb-93ad-a94aae203114 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:08.867335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31efb498-54de-4ddb-93ad-a94aae203114 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:08.926741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31efb498-54de-4ddb-93ad-a94aae203114 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:08.934147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-31efb498-54de-4ddb-93ad-a94aae203114 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080227 Jul 27 20:32:08.934707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 690/1344] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:08 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:09.694842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e80297f3-073f-40d5-80f6-347695325064 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:09.696956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e80297f3-073f-40d5-80f6-347695325064 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:09.703989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e80297f3-073f-40d5-80f6-347695325064 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:09.704454 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e80297f3-073f-40d5-80f6-347695325064 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:09.705218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e80297f3-073f-40d5-80f6-347695325064 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:09.705646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e80297f3-073f-40d5-80f6-347695325064 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:09.733690 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e80297f3-073f-40d5-80f6-347695325064 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042961 Jul 27 20:32:09.734562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 655/1345] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:09 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:09.954734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e3e20914-356f-44a5-acd7-df1316feb8de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:09.955294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e3e20914-356f-44a5-acd7-df1316feb8de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:09.961769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3e20914-356f-44a5-acd7-df1316feb8de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:09.962228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3e20914-356f-44a5-acd7-df1316feb8de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:09.962984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3e20914-356f-44a5-acd7-df1316feb8de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:09.963421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3e20914-356f-44a5-acd7-df1316feb8de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:10.022990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e3e20914-356f-44a5-acd7-df1316feb8de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:10.030341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e3e20914-356f-44a5-acd7-df1316feb8de tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079593 Jul 27 20:32:10.030934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 691/1346] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:09 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:10.746391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-16864d97-790a-479c-bb54-f714ce3c5c92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:10.748544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-16864d97-790a-479c-bb54-f714ce3c5c92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:10.755156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16864d97-790a-479c-bb54-f714ce3c5c92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:10.755608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16864d97-790a-479c-bb54-f714ce3c5c92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:10.756371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16864d97-790a-479c-bb54-f714ce3c5c92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:10.756832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16864d97-790a-479c-bb54-f714ce3c5c92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:10.786294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-16864d97-790a-479c-bb54-f714ce3c5c92 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044242 Jul 27 20:32:10.786848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 656/1347] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:10 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:11.051048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-088f51fc-ea25-4c23-a830-885d61203097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:11.051581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-088f51fc-ea25-4c23-a830-885d61203097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:11.058091 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-088f51fc-ea25-4c23-a830-885d61203097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:11.058543 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-088f51fc-ea25-4c23-a830-885d61203097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:11.059303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-088f51fc-ea25-4c23-a830-885d61203097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:11.059738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-088f51fc-ea25-4c23-a830-885d61203097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:11.122082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-088f51fc-ea25-4c23-a830-885d61203097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:11.130148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-088f51fc-ea25-4c23-a830-885d61203097 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083032 Jul 27 20:32:11.130715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 692/1348] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:11.799209 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-314af742-8aaa-432c-90e1-5bcc5efc0eef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:11.801400 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-314af742-8aaa-432c-90e1-5bcc5efc0eef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:11.807824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-314af742-8aaa-432c-90e1-5bcc5efc0eef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:11.808272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-314af742-8aaa-432c-90e1-5bcc5efc0eef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:11.809061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-314af742-8aaa-432c-90e1-5bcc5efc0eef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:11.809500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-314af742-8aaa-432c-90e1-5bcc5efc0eef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:11.837619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-314af742-8aaa-432c-90e1-5bcc5efc0eef tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043012 Jul 27 20:32:11.838172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 657/1349] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:11 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:12.151379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-534734e7-740d-42f8-b77d-bf3aa9a9e770 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:12.151888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-534734e7-740d-42f8-b77d-bf3aa9a9e770 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:12.158857 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-534734e7-740d-42f8-b77d-bf3aa9a9e770 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:12.159295 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-534734e7-740d-42f8-b77d-bf3aa9a9e770 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:12.160033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-534734e7-740d-42f8-b77d-bf3aa9a9e770 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:12.160482 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-534734e7-740d-42f8-b77d-bf3aa9a9e770 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:12.219981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-534734e7-740d-42f8-b77d-bf3aa9a9e770 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:12.227595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-534734e7-740d-42f8-b77d-bf3aa9a9e770 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080111 Jul 27 20:32:12.228162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 693/1350] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:12.849519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0cb82c51-4072-4181-8ae6-db791b6bccab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:12.851717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0cb82c51-4072-4181-8ae6-db791b6bccab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:12.858237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0cb82c51-4072-4181-8ae6-db791b6bccab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:12.858688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0cb82c51-4072-4181-8ae6-db791b6bccab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:12.859938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0cb82c51-4072-4181-8ae6-db791b6bccab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:12.860397 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0cb82c51-4072-4181-8ae6-db791b6bccab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:12.889564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0cb82c51-4072-4181-8ae6-db791b6bccab tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044066 Jul 27 20:32:12.890112 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 658/1351] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:12 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:13.248522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-243b6fd9-248f-43f5-a120-75cc42a7c141 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:13.249175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-243b6fd9-248f-43f5-a120-75cc42a7c141 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:13.255563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-243b6fd9-248f-43f5-a120-75cc42a7c141 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:13.262120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-243b6fd9-248f-43f5-a120-75cc42a7c141 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:13.262120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-243b6fd9-248f-43f5-a120-75cc42a7c141 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:13.262120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-243b6fd9-248f-43f5-a120-75cc42a7c141 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:13.318397 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-243b6fd9-248f-43f5-a120-75cc42a7c141 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:13.325968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-243b6fd9-248f-43f5-a120-75cc42a7c141 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081318 Jul 27 20:32:13.326531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 694/1352] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:13.901034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0b901bb3-0f01-4ab5-a21f-eaac1470f4b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:13.908292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0b901bb3-0f01-4ab5-a21f-eaac1470f4b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:13.910045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b901bb3-0f01-4ab5-a21f-eaac1470f4b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:13.910493 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b901bb3-0f01-4ab5-a21f-eaac1470f4b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:13.911281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b901bb3-0f01-4ab5-a21f-eaac1470f4b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:13.911719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b901bb3-0f01-4ab5-a21f-eaac1470f4b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:13.940572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0b901bb3-0f01-4ab5-a21f-eaac1470f4b7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043498 Jul 27 20:32:13.941126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 659/1353] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:13 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:14.347040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-68c1f02b-2b82-47ee-9b21-668107d567f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:14.347660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-68c1f02b-2b82-47ee-9b21-668107d567f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:14.354294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68c1f02b-2b82-47ee-9b21-668107d567f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:14.354740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68c1f02b-2b82-47ee-9b21-668107d567f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:14.355578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68c1f02b-2b82-47ee-9b21-668107d567f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:14.356004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68c1f02b-2b82-47ee-9b21-668107d567f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:14.415920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-68c1f02b-2b82-47ee-9b21-668107d567f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:14.423973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-68c1f02b-2b82-47ee-9b21-668107d567f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080839 Jul 27 20:32:14.424616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 695/1354] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:14.952984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5202179f-80e6-45c3-83a5-044ced7fcd45 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:14.955729 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5202179f-80e6-45c3-83a5-044ced7fcd45 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:14.962372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5202179f-80e6-45c3-83a5-044ced7fcd45 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:14.962823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5202179f-80e6-45c3-83a5-044ced7fcd45 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:14.963581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5202179f-80e6-45c3-83a5-044ced7fcd45 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:14.964014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5202179f-80e6-45c3-83a5-044ced7fcd45 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:14.992501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5202179f-80e6-45c3-83a5-044ced7fcd45 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043436 Jul 27 20:32:14.993072 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 660/1355] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:14 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:15.444679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7257e0b7-c72b-4af7-a98c-f37fa62a782a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:15.445324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7257e0b7-c72b-4af7-a98c-f37fa62a782a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:15.451849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7257e0b7-c72b-4af7-a98c-f37fa62a782a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:15.452303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7257e0b7-c72b-4af7-a98c-f37fa62a782a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:15.453104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7257e0b7-c72b-4af7-a98c-f37fa62a782a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:15.453539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7257e0b7-c72b-4af7-a98c-f37fa62a782a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:15.517872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7257e0b7-c72b-4af7-a98c-f37fa62a782a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:15.525355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7257e0b7-c72b-4af7-a98c-f37fa62a782a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084591 Jul 27 20:32:15.525936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 696/1356] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:15 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:16.007236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0f46cf10-5f35-4d8a-9b9f-59919a5c47e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:16.009370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0f46cf10-5f35-4d8a-9b9f-59919a5c47e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:16.015682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f46cf10-5f35-4d8a-9b9f-59919a5c47e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:16.016119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f46cf10-5f35-4d8a-9b9f-59919a5c47e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:16.017419 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f46cf10-5f35-4d8a-9b9f-59919a5c47e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:16.017847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f46cf10-5f35-4d8a-9b9f-59919a5c47e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:16.046597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0f46cf10-5f35-4d8a-9b9f-59919a5c47e5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043540 Jul 27 20:32:16.047160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 661/1357] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:15 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:16.546643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5d109576-4c4b-482b-95c7-83c1643259af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:16.547250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5d109576-4c4b-482b-95c7-83c1643259af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:16.555049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d109576-4c4b-482b-95c7-83c1643259af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:16.555493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d109576-4c4b-482b-95c7-83c1643259af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:16.556257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d109576-4c4b-482b-95c7-83c1643259af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:16.556721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d109576-4c4b-482b-95c7-83c1643259af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:16.620832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5d109576-4c4b-482b-95c7-83c1643259af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:16.629028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5d109576-4c4b-482b-95c7-83c1643259af tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.086225 Jul 27 20:32:16.629596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 697/1358] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:17.059048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-43bcadb8-c690-4bec-9dc6-df22c17a1df5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:17.061223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-43bcadb8-c690-4bec-9dc6-df22c17a1df5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:17.067882 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43bcadb8-c690-4bec-9dc6-df22c17a1df5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:17.068339 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43bcadb8-c690-4bec-9dc6-df22c17a1df5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:17.069127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43bcadb8-c690-4bec-9dc6-df22c17a1df5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:17.069566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43bcadb8-c690-4bec-9dc6-df22c17a1df5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:17.098789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-43bcadb8-c690-4bec-9dc6-df22c17a1df5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043765 Jul 27 20:32:17.099354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 662/1359] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:17 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:17.649908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-39d9b115-494e-4d6c-ba98-ed537db6759d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:17.650460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39d9b115-494e-4d6c-ba98-ed537db6759d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:17.657477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39d9b115-494e-4d6c-ba98-ed537db6759d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:17.657927 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39d9b115-494e-4d6c-ba98-ed537db6759d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:17.658685 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39d9b115-494e-4d6c-ba98-ed537db6759d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:17.659120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39d9b115-494e-4d6c-ba98-ed537db6759d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:17.719660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-39d9b115-494e-4d6c-ba98-ed537db6759d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:17.727185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-39d9b115-494e-4d6c-ba98-ed537db6759d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081286 Jul 27 20:32:17.727754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 698/1360] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:18.111668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ed66e18a-f10a-4b60-b79b-73215395dac2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:18.113860 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ed66e18a-f10a-4b60-b79b-73215395dac2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:18.120604 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed66e18a-f10a-4b60-b79b-73215395dac2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:18.121053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed66e18a-f10a-4b60-b79b-73215395dac2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:18.121811 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed66e18a-f10a-4b60-b79b-73215395dac2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:18.122249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed66e18a-f10a-4b60-b79b-73215395dac2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:18.152016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ed66e18a-f10a-4b60-b79b-73215395dac2 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044882 Jul 27 20:32:18.152602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 663/1361] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:18 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:18.748103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7d3c81df-e1d6-4624-8569-acf7f4c8a9e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:18.748756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7d3c81df-e1d6-4624-8569-acf7f4c8a9e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:18.755268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d3c81df-e1d6-4624-8569-acf7f4c8a9e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:18.758490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d3c81df-e1d6-4624-8569-acf7f4c8a9e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:18.758490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d3c81df-e1d6-4624-8569-acf7f4c8a9e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:18.758490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d3c81df-e1d6-4624-8569-acf7f4c8a9e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:18.819608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7d3c81df-e1d6-4624-8569-acf7f4c8a9e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:18.827261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7d3c81df-e1d6-4624-8569-acf7f4c8a9e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083289 Jul 27 20:32:18.828176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 699/1362] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:19.164501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d5662e0e-2e8e-4bae-b4ff-4f60f3ee3e33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:19.170713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d5662e0e-2e8e-4bae-b4ff-4f60f3ee3e33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:19.173692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5662e0e-2e8e-4bae-b4ff-4f60f3ee3e33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:19.174135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5662e0e-2e8e-4bae-b4ff-4f60f3ee3e33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:19.175112 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5662e0e-2e8e-4bae-b4ff-4f60f3ee3e33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:19.175710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5662e0e-2e8e-4bae-b4ff-4f60f3ee3e33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:19.201473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:19.206533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d5662e0e-2e8e-4bae-b4ff-4f60f3ee3e33 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046164 Jul 27 20:32:19.207102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 664/1363] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:19 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:19.848407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-87b7183d-ff17-44d8-a155-d3e3af260e56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:19.849010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-87b7183d-ff17-44d8-a155-d3e3af260e56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:19.855408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87b7183d-ff17-44d8-a155-d3e3af260e56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:19.855859 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87b7183d-ff17-44d8-a155-d3e3af260e56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:19.856662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87b7183d-ff17-44d8-a155-d3e3af260e56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:19.857096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87b7183d-ff17-44d8-a155-d3e3af260e56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:19.921066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-87b7183d-ff17-44d8-a155-d3e3af260e56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:19.929228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-87b7183d-ff17-44d8-a155-d3e3af260e56 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084852 Jul 27 20:32:19.929799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 700/1364] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:20.223017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-acff51c5-f0c1-448f-9ed1-01e6c632e892 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:20.225233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-acff51c5-f0c1-448f-9ed1-01e6c632e892 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:20.232120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acff51c5-f0c1-448f-9ed1-01e6c632e892 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:20.232710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acff51c5-f0c1-448f-9ed1-01e6c632e892 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:20.233464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acff51c5-f0c1-448f-9ed1-01e6c632e892 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:20.233899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acff51c5-f0c1-448f-9ed1-01e6c632e892 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:20.263889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-acff51c5-f0c1-448f-9ed1-01e6c632e892 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045439 Jul 27 20:32:20.264475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 665/1365] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:20 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:20.949854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3768d8a2-f26a-4401-a1a6-4ee4d5611a0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:20.950457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3768d8a2-f26a-4401-a1a6-4ee4d5611a0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:20.956843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3768d8a2-f26a-4401-a1a6-4ee4d5611a0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:20.957282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3768d8a2-f26a-4401-a1a6-4ee4d5611a0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:20.958028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3768d8a2-f26a-4401-a1a6-4ee4d5611a0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:20.958452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3768d8a2-f26a-4401-a1a6-4ee4d5611a0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:21.019172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3768d8a2-f26a-4401-a1a6-4ee4d5611a0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:21.026714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3768d8a2-f26a-4401-a1a6-4ee4d5611a0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080717 Jul 27 20:32:21.027287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 701/1366] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:21.277239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cdc9b5ba-2c57-4d0f-ba02-bf5919491609 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:21.279396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cdc9b5ba-2c57-4d0f-ba02-bf5919491609 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:21.286457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cdc9b5ba-2c57-4d0f-ba02-bf5919491609 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:21.286900 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cdc9b5ba-2c57-4d0f-ba02-bf5919491609 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:21.287649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cdc9b5ba-2c57-4d0f-ba02-bf5919491609 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:21.288083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cdc9b5ba-2c57-4d0f-ba02-bf5919491609 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:21.317342 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cdc9b5ba-2c57-4d0f-ba02-bf5919491609 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044067 Jul 27 20:32:21.317930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 666/1367] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:21 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:22.048323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d18b4682-e072-495b-8a2b-432b861fb7aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:22.049001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d18b4682-e072-495b-8a2b-432b861fb7aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:22.055427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d18b4682-e072-495b-8a2b-432b861fb7aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:22.055872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d18b4682-e072-495b-8a2b-432b861fb7aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:22.056656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d18b4682-e072-495b-8a2b-432b861fb7aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:22.057090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d18b4682-e072-495b-8a2b-432b861fb7aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:22.121406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d18b4682-e072-495b-8a2b-432b861fb7aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:22.129388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d18b4682-e072-495b-8a2b-432b861fb7aa tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084975 Jul 27 20:32:22.129965 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 702/1368] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:22.329642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9be1ae4d-ec89-4e10-9089-601167501103 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:22.332393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9be1ae4d-ec89-4e10-9089-601167501103 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:22.338913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9be1ae4d-ec89-4e10-9089-601167501103 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:22.339359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9be1ae4d-ec89-4e10-9089-601167501103 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:22.340121 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9be1ae4d-ec89-4e10-9089-601167501103 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:22.340582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9be1ae4d-ec89-4e10-9089-601167501103 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:22.369069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9be1ae4d-ec89-4e10-9089-601167501103 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043202 Jul 27 20:32:22.369622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 667/1369] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:32:23.149465 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a0244808-2504-4495-a287-7040f3cc6330 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:23.150098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a0244808-2504-4495-a287-7040f3cc6330 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:23.156527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0244808-2504-4495-a287-7040f3cc6330 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:23.156981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0244808-2504-4495-a287-7040f3cc6330 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:23.157734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0244808-2504-4495-a287-7040f3cc6330 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:23.158674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0244808-2504-4495-a287-7040f3cc6330 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:23.217535 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0244808-2504-4495-a287-7040f3cc6330 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:23.225344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a0244808-2504-4495-a287-7040f3cc6330 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079784 Jul 27 20:32:23.225908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 703/1370] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:23.381484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-edfc00b4-62ff-47bf-88b0-3bf0a484fc78 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:23.383628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-edfc00b4-62ff-47bf-88b0-3bf0a484fc78 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:23.390085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-edfc00b4-62ff-47bf-88b0-3bf0a484fc78 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:23.390537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-edfc00b4-62ff-47bf-88b0-3bf0a484fc78 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:23.391295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-edfc00b4-62ff-47bf-88b0-3bf0a484fc78 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:23.391733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-edfc00b4-62ff-47bf-88b0-3bf0a484fc78 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:23.421281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-edfc00b4-62ff-47bf-88b0-3bf0a484fc78 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043796 Jul 27 20:32:23.421769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 668/1371] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:23 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:24.246831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0efb00b3-966e-4525-bae3-d9b72bb94fa2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:24.247445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0efb00b3-966e-4525-bae3-d9b72bb94fa2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:24.254598 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0efb00b3-966e-4525-bae3-d9b72bb94fa2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:24.254988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0efb00b3-966e-4525-bae3-d9b72bb94fa2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:24.255780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0efb00b3-966e-4525-bae3-d9b72bb94fa2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:24.256218 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0efb00b3-966e-4525-bae3-d9b72bb94fa2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:24.319010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0efb00b3-966e-4525-bae3-d9b72bb94fa2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:24.327670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0efb00b3-966e-4525-bae3-d9b72bb94fa2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085005 Jul 27 20:32:24.328243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 704/1372] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:24.432940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9d7e6d3e-d060-4d07-b5e6-71945ab0ed0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:24.435046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9d7e6d3e-d060-4d07-b5e6-71945ab0ed0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:24.441464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9d7e6d3e-d060-4d07-b5e6-71945ab0ed0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:24.441902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9d7e6d3e-d060-4d07-b5e6-71945ab0ed0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:24.442642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9d7e6d3e-d060-4d07-b5e6-71945ab0ed0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:24.443066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9d7e6d3e-d060-4d07-b5e6-71945ab0ed0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:24.471751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9d7e6d3e-d060-4d07-b5e6-71945ab0ed0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042765 Jul 27 20:32:24.472300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 669/1373] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:24 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:25.348892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-51b2ae84-3771-49ee-9e71-983c4113375d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:25.349498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-51b2ae84-3771-49ee-9e71-983c4113375d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:25.355682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51b2ae84-3771-49ee-9e71-983c4113375d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:25.356124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51b2ae84-3771-49ee-9e71-983c4113375d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:25.356894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51b2ae84-3771-49ee-9e71-983c4113375d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:25.357323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51b2ae84-3771-49ee-9e71-983c4113375d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:25.361357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:25.418328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-51b2ae84-3771-49ee-9e71-983c4113375d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:25.425751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-51b2ae84-3771-49ee-9e71-983c4113375d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080747 Jul 27 20:32:25.426319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 705/1374] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:25.483069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-100f1ede-acd5-4f0b-b56f-e5dfd31f1e7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:25.485230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-100f1ede-acd5-4f0b-b56f-e5dfd31f1e7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:25.492226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-100f1ede-acd5-4f0b-b56f-e5dfd31f1e7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:25.492715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-100f1ede-acd5-4f0b-b56f-e5dfd31f1e7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:25.493475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-100f1ede-acd5-4f0b-b56f-e5dfd31f1e7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:25.494186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-100f1ede-acd5-4f0b-b56f-e5dfd31f1e7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:25.523709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-100f1ede-acd5-4f0b-b56f-e5dfd31f1e7b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044541 Jul 27 20:32:25.524274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 670/1375] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:25 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:26.446332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-40af35ad-4da8-46fb-bc20-1e4390b487f3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:26.446941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-40af35ad-4da8-46fb-bc20-1e4390b487f3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:26.453487 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40af35ad-4da8-46fb-bc20-1e4390b487f3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:26.453935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40af35ad-4da8-46fb-bc20-1e4390b487f3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:26.454690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40af35ad-4da8-46fb-bc20-1e4390b487f3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:26.455635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40af35ad-4da8-46fb-bc20-1e4390b487f3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:26.514382 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-40af35ad-4da8-46fb-bc20-1e4390b487f3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:26.522267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-40af35ad-4da8-46fb-bc20-1e4390b487f3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079808 Jul 27 20:32:26.522940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 706/1376] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:26.536917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-16b03728-5d31-4e1f-8c39-cedad57c6a43 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:26.539053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-16b03728-5d31-4e1f-8c39-cedad57c6a43 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:26.545441 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16b03728-5d31-4e1f-8c39-cedad57c6a43 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:26.545888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16b03728-5d31-4e1f-8c39-cedad57c6a43 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:26.546750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16b03728-5d31-4e1f-8c39-cedad57c6a43 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:26.547290 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16b03728-5d31-4e1f-8c39-cedad57c6a43 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:26.577186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-16b03728-5d31-4e1f-8c39-cedad57c6a43 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044862 Jul 27 20:32:26.577747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 671/1377] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:26 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:27.543675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2773c644-6453-45b6-84d6-72982a46705c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:27.544289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2773c644-6453-45b6-84d6-72982a46705c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:27.550930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2773c644-6453-45b6-84d6-72982a46705c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:27.551377 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2773c644-6453-45b6-84d6-72982a46705c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:27.552132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2773c644-6453-45b6-84d6-72982a46705c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:27.552596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2773c644-6453-45b6-84d6-72982a46705c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:27.590261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fd752c6a-f566-450e-b97c-cf15c397084d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:27.592585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fd752c6a-f566-450e-b97c-cf15c397084d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:27.599070 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd752c6a-f566-450e-b97c-cf15c397084d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:27.599519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd752c6a-f566-450e-b97c-cf15c397084d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:27.600280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd752c6a-f566-450e-b97c-cf15c397084d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:27.600737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd752c6a-f566-450e-b97c-cf15c397084d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:27.615581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2773c644-6453-45b6-84d6-72982a46705c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:27.623246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2773c644-6453-45b6-84d6-72982a46705c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083448 Jul 27 20:32:27.623936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 707/1378] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:27 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:27.631810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fd752c6a-f566-450e-b97c-cf15c397084d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045383 Jul 27 20:32:27.632365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 672/1379] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:27 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:32:28.645060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e259f4bd-b725-4bed-a52b-f1d2eac027d5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:28.645587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e7c67839-c2fb-4aea-bbd1-a475e42cb0b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:28.645960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e7c67839-c2fb-4aea-bbd1-a475e42cb0b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:28.647139 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e259f4bd-b725-4bed-a52b-f1d2eac027d5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:28.652289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7c67839-c2fb-4aea-bbd1-a475e42cb0b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:28.652773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7c67839-c2fb-4aea-bbd1-a475e42cb0b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:28.653535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7c67839-c2fb-4aea-bbd1-a475e42cb0b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:28.653777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e259f4bd-b725-4bed-a52b-f1d2eac027d5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:28.653960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7c67839-c2fb-4aea-bbd1-a475e42cb0b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:28.654256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e259f4bd-b725-4bed-a52b-f1d2eac027d5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:28.655122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e259f4bd-b725-4bed-a52b-f1d2eac027d5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:28.655589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e259f4bd-b725-4bed-a52b-f1d2eac027d5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:28.686158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e259f4bd-b725-4bed-a52b-f1d2eac027d5 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045699 Jul 27 20:32:28.686738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 708/1380] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:28 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:28.723429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7c67839-c2fb-4aea-bbd1-a475e42cb0b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:28.730932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e7c67839-c2fb-4aea-bbd1-a475e42cb0b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.090013 Jul 27 20:32:28.731499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 673/1381] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:32:29.698627 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2293767d-4d88-4b78-a914-9be0da65f081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:29.700768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2293767d-4d88-4b78-a914-9be0da65f081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:29.707753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2293767d-4d88-4b78-a914-9be0da65f081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:29.708192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2293767d-4d88-4b78-a914-9be0da65f081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:29.708969 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2293767d-4d88-4b78-a914-9be0da65f081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:29.709402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2293767d-4d88-4b78-a914-9be0da65f081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:29.739000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2293767d-4d88-4b78-a914-9be0da65f081 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044538 Jul 27 20:32:29.739545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 709/1382] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:29 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:29.750864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5a4a3498-0e12-4add-910a-4045742fa609 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:29.751483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5a4a3498-0e12-4add-910a-4045742fa609 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:29.758459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a4a3498-0e12-4add-910a-4045742fa609 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:29.758910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a4a3498-0e12-4add-910a-4045742fa609 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:29.759668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a4a3498-0e12-4add-910a-4045742fa609 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:29.760102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a4a3498-0e12-4add-910a-4045742fa609 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:29.820239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5a4a3498-0e12-4add-910a-4045742fa609 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:29.827521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5a4a3498-0e12-4add-910a-4045742fa609 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080423 Jul 27 20:32:29.828092 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 674/1383] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:30.751190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd8c2ec6-c00c-4d89-a920-ba88bc6ed1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:30.753374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fd8c2ec6-c00c-4d89-a920-ba88bc6ed1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:30.759744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8c2ec6-c00c-4d89-a920-ba88bc6ed1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:30.760184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8c2ec6-c00c-4d89-a920-ba88bc6ed1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:30.760968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8c2ec6-c00c-4d89-a920-ba88bc6ed1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:30.761394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8c2ec6-c00c-4d89-a920-ba88bc6ed1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:30.790444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd8c2ec6-c00c-4d89-a920-ba88bc6ed1a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043214 Jul 27 20:32:30.790981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 710/1384] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:30 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:30.850892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1a4c3da2-717e-4ba5-9397-3760fd0110ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:30.851503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1a4c3da2-717e-4ba5-9397-3760fd0110ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:30.857915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a4c3da2-717e-4ba5-9397-3760fd0110ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:30.858371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a4c3da2-717e-4ba5-9397-3760fd0110ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:30.859123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a4c3da2-717e-4ba5-9397-3760fd0110ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:30.859558 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a4c3da2-717e-4ba5-9397-3760fd0110ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:30.919942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1a4c3da2-717e-4ba5-9397-3760fd0110ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:30.927407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1a4c3da2-717e-4ba5-9397-3760fd0110ee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080317 Jul 27 20:32:30.928004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 675/1385] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:31.803213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-264e1f9a-234e-4fad-9b07-e208a6831a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:31.805383 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-264e1f9a-234e-4fad-9b07-e208a6831a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:31.811726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-264e1f9a-234e-4fad-9b07-e208a6831a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:31.812169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-264e1f9a-234e-4fad-9b07-e208a6831a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:31.812953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-264e1f9a-234e-4fad-9b07-e208a6831a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:31.813381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-264e1f9a-234e-4fad-9b07-e208a6831a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:31.841961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-264e1f9a-234e-4fad-9b07-e208a6831a1a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043280 Jul 27 20:32:31.842504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 711/1386] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:31 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:31.948071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6cbffe62-be97-4525-a8c7-7b5164af5f43 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:31.948703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6cbffe62-be97-4525-a8c7-7b5164af5f43 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:31.955114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6cbffe62-be97-4525-a8c7-7b5164af5f43 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:31.955556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6cbffe62-be97-4525-a8c7-7b5164af5f43 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:31.956294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6cbffe62-be97-4525-a8c7-7b5164af5f43 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:31.956757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6cbffe62-be97-4525-a8c7-7b5164af5f43 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:32.018196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6cbffe62-be97-4525-a8c7-7b5164af5f43 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:32.030762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6cbffe62-be97-4525-a8c7-7b5164af5f43 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.086413 Jul 27 20:32:32.031448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 676/1387] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:32.854260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-51858bc0-3e8c-4321-ab93-24103d7e2b85 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:32.856427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-51858bc0-3e8c-4321-ab93-24103d7e2b85 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:32.858697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=56 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:32.863413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51858bc0-3e8c-4321-ab93-24103d7e2b85 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:32.863864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51858bc0-3e8c-4321-ab93-24103d7e2b85 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:32.864658 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51858bc0-3e8c-4321-ab93-24103d7e2b85 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:32.865094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51858bc0-3e8c-4321-ab93-24103d7e2b85 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:32.896307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-51858bc0-3e8c-4321-ab93-24103d7e2b85 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046038 Jul 27 20:32:32.896891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 712/1388] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:32 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:33.052916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-20ed8b64-164d-4581-8c3a-3e5c3a8575f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:33.053529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-20ed8b64-164d-4581-8c3a-3e5c3a8575f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:33.056481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=60 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:33.061736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20ed8b64-164d-4581-8c3a-3e5c3a8575f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:33.062248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20ed8b64-164d-4581-8c3a-3e5c3a8575f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:33.063340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20ed8b64-164d-4581-8c3a-3e5c3a8575f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:33.063761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20ed8b64-164d-4581-8c3a-3e5c3a8575f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:33.127671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-20ed8b64-164d-4581-8c3a-3e5c3a8575f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:33.135127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-20ed8b64-164d-4581-8c3a-3e5c3a8575f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.086760 Jul 27 20:32:33.135693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 677/1389] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:33 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:33.908774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9e8a6de9-148b-4348-98e1-0fbacf7064a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:33.910948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9e8a6de9-148b-4348-98e1-0fbacf7064a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:33.917358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9e8a6de9-148b-4348-98e1-0fbacf7064a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:33.917802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9e8a6de9-148b-4348-98e1-0fbacf7064a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:33.918549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9e8a6de9-148b-4348-98e1-0fbacf7064a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:33.918979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9e8a6de9-148b-4348-98e1-0fbacf7064a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:33.947108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9e8a6de9-148b-4348-98e1-0fbacf7064a4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043026 Jul 27 20:32:33.947650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 713/1390] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:33 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:34.155743 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-44de86e6-9675-45e1-b3a2-f95b035f9021 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:34.156354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-44de86e6-9675-45e1-b3a2-f95b035f9021 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:34.166810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44de86e6-9675-45e1-b3a2-f95b035f9021 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:34.166810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44de86e6-9675-45e1-b3a2-f95b035f9021 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:34.166810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44de86e6-9675-45e1-b3a2-f95b035f9021 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:34.166810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44de86e6-9675-45e1-b3a2-f95b035f9021 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:34.224635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-44de86e6-9675-45e1-b3a2-f95b035f9021 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:34.232233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-44de86e6-9675-45e1-b3a2-f95b035f9021 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080447 Jul 27 20:32:34.232830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 678/1391] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:34.959394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d7fd9df-b8bd-483b-a563-9241b28d6ff7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:34.961588 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1d7fd9df-b8bd-483b-a563-9241b28d6ff7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:34.968365 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d7fd9df-b8bd-483b-a563-9241b28d6ff7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:34.968759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d7fd9df-b8bd-483b-a563-9241b28d6ff7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:34.969523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d7fd9df-b8bd-483b-a563-9241b28d6ff7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:34.969949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d7fd9df-b8bd-483b-a563-9241b28d6ff7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:35.002333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1d7fd9df-b8bd-483b-a563-9241b28d6ff7 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046888 Jul 27 20:32:35.002920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 714/1392] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:34 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:35.252958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-86fd583d-61b3-45ce-82ff-f85a9a1fdfb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:35.253841 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-86fd583d-61b3-45ce-82ff-f85a9a1fdfb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:35.260204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86fd583d-61b3-45ce-82ff-f85a9a1fdfb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:35.260722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86fd583d-61b3-45ce-82ff-f85a9a1fdfb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:35.264653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86fd583d-61b3-45ce-82ff-f85a9a1fdfb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:35.264653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86fd583d-61b3-45ce-82ff-f85a9a1fdfb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:35.324359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-86fd583d-61b3-45ce-82ff-f85a9a1fdfb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:35.332402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-86fd583d-61b3-45ce-82ff-f85a9a1fdfb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083326 Jul 27 20:32:35.332990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 679/1393] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:35 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:36.014405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d656afd2-bcc3-416a-9000-d79142f3ca53 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:36.016582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d656afd2-bcc3-416a-9000-d79142f3ca53 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:36.023460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d656afd2-bcc3-416a-9000-d79142f3ca53 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:36.023905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d656afd2-bcc3-416a-9000-d79142f3ca53 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:36.024687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d656afd2-bcc3-416a-9000-d79142f3ca53 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:36.025119 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d656afd2-bcc3-416a-9000-d79142f3ca53 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:36.054128 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d656afd2-bcc3-416a-9000-d79142f3ca53 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043930 Jul 27 20:32:36.054695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 715/1394] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:36 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:36.354046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cc21530e-dc8a-47d9-8fd9-ec19bc842ed8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:36.354685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cc21530e-dc8a-47d9-8fd9-ec19bc842ed8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:36.361319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc21530e-dc8a-47d9-8fd9-ec19bc842ed8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:36.361768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc21530e-dc8a-47d9-8fd9-ec19bc842ed8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:36.362524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc21530e-dc8a-47d9-8fd9-ec19bc842ed8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:36.362957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc21530e-dc8a-47d9-8fd9-ec19bc842ed8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:36.425441 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cc21530e-dc8a-47d9-8fd9-ec19bc842ed8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:36.432922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cc21530e-dc8a-47d9-8fd9-ec19bc842ed8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082775 Jul 27 20:32:36.433481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 680/1395] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:37.066042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5cdb2b97-0491-409d-9612-cff2d758db9b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:37.068182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5cdb2b97-0491-409d-9612-cff2d758db9b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:37.074613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cdb2b97-0491-409d-9612-cff2d758db9b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:37.075062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cdb2b97-0491-409d-9612-cff2d758db9b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:37.075820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cdb2b97-0491-409d-9612-cff2d758db9b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:37.076254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cdb2b97-0491-409d-9612-cff2d758db9b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:37.107296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5cdb2b97-0491-409d-9612-cff2d758db9b tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045326 Jul 27 20:32:37.107843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 716/1396] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 20:32:37 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:32:37.454051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f9f841bc-73d8-41f9-b19b-12b30601aa3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:37.455311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f9f841bc-73d8-41f9-b19b-12b30601aa3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:37.461703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9f841bc-73d8-41f9-b19b-12b30601aa3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:37.462152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9f841bc-73d8-41f9-b19b-12b30601aa3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:37.462907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9f841bc-73d8-41f9-b19b-12b30601aa3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:37.463340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9f841bc-73d8-41f9-b19b-12b30601aa3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:37.480534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:37.525353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9f841bc-73d8-41f9-b19b-12b30601aa3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:37.533015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f9f841bc-73d8-41f9-b19b-12b30601aa3b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082792 Jul 27 20:32:37.533584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 681/1397] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:38.120225 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:32:38.122419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:38.128919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:38.129363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:38.130113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:38.130544 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:38.152488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Instance 0929536d-2d91-4e59-8f36-474025d921ef is not ready Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: POST /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/action HTTP/1.1 Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 27 Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:32:38.158996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {"os-getConsoleOutput": {}} Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:32:38.160766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 0929536d-2d91-4e59-8f36-474025d921ef is not ready Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '0929536d-2d91-4e59-8f36-474025d921ef', 'body': {'os-getConsoleOutput': {}}} Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 50, in get_console_output Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi output = self.compute_api.get_console_output(context, Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 218, in wrapped Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotReady(instance_id=instance.uuid) Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotReady: Instance 0929536d-2d91-4e59-8f36-474025d921ef is not ready Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:32:38.161672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 60, in get_console_output Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 0929536d-2d91-4e59-8f36-474025d921ef is not ready Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0929536d-2d91-4e59-8f36-474025d921ef is not ready Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 409 to user: Instance 0929536d-2d91-4e59-8f36-474025d921ef is not ready {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:32:38.163214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e6af036d-6357-4123-910c-ef8e7308b75d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "POST /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/action" status: 409 len: 110 microversion: 2.20 time: 0.044412 Jul 27 20:32:38.164340 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 717/1398] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Jul 27 20:32:38 2022] POST /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef/action => generated 110 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:32:38.553668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7ad7e092-c755-4db6-a74e-1507b79fa9ac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:38.554295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7ad7e092-c755-4db6-a74e-1507b79fa9ac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:38.560795 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ad7e092-c755-4db6-a74e-1507b79fa9ac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:38.561245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ad7e092-c755-4db6-a74e-1507b79fa9ac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:38.562031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ad7e092-c755-4db6-a74e-1507b79fa9ac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:38.562469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ad7e092-c755-4db6-a74e-1507b79fa9ac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:38.621670 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7ad7e092-c755-4db6-a74e-1507b79fa9ac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:38.629610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7ad7e092-c755-4db6-a74e-1507b79fa9ac tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079791 Jul 27 20:32:38.630183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 682/1399] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:39.650322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fdb0d2e2-8a90-47ca-97c1-ecb12d959f2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:39.650854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fdb0d2e2-8a90-47ca-97c1-ecb12d959f2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:39.657331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdb0d2e2-8a90-47ca-97c1-ecb12d959f2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:39.657779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdb0d2e2-8a90-47ca-97c1-ecb12d959f2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:39.658533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdb0d2e2-8a90-47ca-97c1-ecb12d959f2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:39.659470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fdb0d2e2-8a90-47ca-97c1-ecb12d959f2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:39.719671 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fdb0d2e2-8a90-47ca-97c1-ecb12d959f2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:39.727800 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fdb0d2e2-8a90-47ca-97c1-ecb12d959f2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081509 Jul 27 20:32:39.728385 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 718/1400] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:40.748736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-112f8794-d142-4648-9911-ff4e16a367e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:40.749367 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-112f8794-d142-4648-9911-ff4e16a367e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:40.757778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-112f8794-d142-4648-9911-ff4e16a367e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:40.759779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-112f8794-d142-4648-9911-ff4e16a367e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:40.761642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-112f8794-d142-4648-9911-ff4e16a367e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:40.762088 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-112f8794-d142-4648-9911-ff4e16a367e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:40.824300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-112f8794-d142-4648-9911-ff4e16a367e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:40.831726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-112f8794-d142-4648-9911-ff4e16a367e5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.086846 Jul 27 20:32:40.832326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 683/1401] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:40 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:41.852254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fa5b8667-f9dc-44cf-8915-9acca6e87dd9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:41.852904 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fa5b8667-f9dc-44cf-8915-9acca6e87dd9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:41.859393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fa5b8667-f9dc-44cf-8915-9acca6e87dd9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:41.859840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fa5b8667-f9dc-44cf-8915-9acca6e87dd9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:41.860629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fa5b8667-f9dc-44cf-8915-9acca6e87dd9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:41.861063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fa5b8667-f9dc-44cf-8915-9acca6e87dd9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:41.922204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fa5b8667-f9dc-44cf-8915-9acca6e87dd9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:41.930432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fa5b8667-f9dc-44cf-8915-9acca6e87dd9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082078 Jul 27 20:32:41.930991 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 719/1402] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:41 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:42.950947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a9ff4cac-43d0-41aa-8342-676c2cbe9c97 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:42.951506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a9ff4cac-43d0-41aa-8342-676c2cbe9c97 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:42.958624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a9ff4cac-43d0-41aa-8342-676c2cbe9c97 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:42.959079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a9ff4cac-43d0-41aa-8342-676c2cbe9c97 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:42.959832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a9ff4cac-43d0-41aa-8342-676c2cbe9c97 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:42.960265 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a9ff4cac-43d0-41aa-8342-676c2cbe9c97 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:43.021324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a9ff4cac-43d0-41aa-8342-676c2cbe9c97 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:43.028863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a9ff4cac-43d0-41aa-8342-676c2cbe9c97 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081765 Jul 27 20:32:43.029437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 684/1403] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:32:44.049864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b375bf90-269d-4c97-b6b2-d1ec37bac812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:44.050494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b375bf90-269d-4c97-b6b2-d1ec37bac812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:44.057190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b375bf90-269d-4c97-b6b2-d1ec37bac812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:44.057642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b375bf90-269d-4c97-b6b2-d1ec37bac812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:44.058405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b375bf90-269d-4c97-b6b2-d1ec37bac812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:44.058844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b375bf90-269d-4c97-b6b2-d1ec37bac812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:44.120125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b375bf90-269d-4c97-b6b2-d1ec37bac812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:44.127550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b375bf90-269d-4c97-b6b2-d1ec37bac812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081774 Jul 27 20:32:44.128123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 720/1404] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:45.157221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b0a7fa69-45d8-4ea5-9ae3-37157246efe8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:45.157813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b0a7fa69-45d8-4ea5-9ae3-37157246efe8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:45.163912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0a7fa69-45d8-4ea5-9ae3-37157246efe8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:45.164369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0a7fa69-45d8-4ea5-9ae3-37157246efe8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:45.166576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0a7fa69-45d8-4ea5-9ae3-37157246efe8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:45.167019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0a7fa69-45d8-4ea5-9ae3-37157246efe8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:45.234601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b0a7fa69-45d8-4ea5-9ae3-37157246efe8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:45.243859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b0a7fa69-45d8-4ea5-9ae3-37157246efe8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.090647 Jul 27 20:32:45.244755 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 685/1405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:46.265431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-04c37af4-bda6-4dd2-a228-da961b48cd42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:46.266456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-04c37af4-bda6-4dd2-a228-da961b48cd42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:46.272539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04c37af4-bda6-4dd2-a228-da961b48cd42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:46.272987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04c37af4-bda6-4dd2-a228-da961b48cd42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:46.273742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04c37af4-bda6-4dd2-a228-da961b48cd42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:46.274172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04c37af4-bda6-4dd2-a228-da961b48cd42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:46.334225 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-04c37af4-bda6-4dd2-a228-da961b48cd42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:46.341690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-04c37af4-bda6-4dd2-a228-da961b48cd42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080123 Jul 27 20:32:46.342256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 721/1406] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:47.362951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-46b33545-0dc6-4682-8393-301f940fd7e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:47.363567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-46b33545-0dc6-4682-8393-301f940fd7e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:47.370577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-46b33545-0dc6-4682-8393-301f940fd7e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:47.371026 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-46b33545-0dc6-4682-8393-301f940fd7e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:47.371782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-46b33545-0dc6-4682-8393-301f940fd7e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:47.372218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-46b33545-0dc6-4682-8393-301f940fd7e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:47.435842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-46b33545-0dc6-4682-8393-301f940fd7e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:47.443200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-46b33545-0dc6-4682-8393-301f940fd7e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084105 Jul 27 20:32:47.443768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 686/1407] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:47 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:48.463027 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d113eafd-1e17-4458-af55-32d27639e7ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:48.463934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d113eafd-1e17-4458-af55-32d27639e7ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:48.470540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d113eafd-1e17-4458-af55-32d27639e7ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:48.470992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d113eafd-1e17-4458-af55-32d27639e7ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:48.471753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d113eafd-1e17-4458-af55-32d27639e7ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:48.472191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d113eafd-1e17-4458-af55-32d27639e7ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:48.479384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:48.541118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d113eafd-1e17-4458-af55-32d27639e7ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:48.548483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d113eafd-1e17-4458-af55-32d27639e7ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.089293 Jul 27 20:32:48.549057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 722/1408] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:48 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:49.569849 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c516d6b1-ee79-4624-951a-9d933bb57ae6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:49.570464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c516d6b1-ee79-4624-951a-9d933bb57ae6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:49.577116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c516d6b1-ee79-4624-951a-9d933bb57ae6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:49.577568 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c516d6b1-ee79-4624-951a-9d933bb57ae6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:49.578321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c516d6b1-ee79-4624-951a-9d933bb57ae6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:49.578758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c516d6b1-ee79-4624-951a-9d933bb57ae6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:49.641886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c516d6b1-ee79-4624-951a-9d933bb57ae6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:49.649807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c516d6b1-ee79-4624-951a-9d933bb57ae6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083849 Jul 27 20:32:49.650378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 687/1409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:50.671118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c2070664-c9e2-4ae2-a96f-ecd208e85952 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:50.671773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c2070664-c9e2-4ae2-a96f-ecd208e85952 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:50.678993 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c2070664-c9e2-4ae2-a96f-ecd208e85952 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:50.679446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c2070664-c9e2-4ae2-a96f-ecd208e85952 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:50.680199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c2070664-c9e2-4ae2-a96f-ecd208e85952 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:50.680657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c2070664-c9e2-4ae2-a96f-ecd208e85952 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:50.741718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c2070664-c9e2-4ae2-a96f-ecd208e85952 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:50.749369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c2070664-c9e2-4ae2-a96f-ecd208e85952 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082122 Jul 27 20:32:50.749942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 723/1410] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:51.770122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d1d86fdf-ed36-4fed-aabf-09a4e1ba41a1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:51.770732 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d1d86fdf-ed36-4fed-aabf-09a4e1ba41a1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:51.777175 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1d86fdf-ed36-4fed-aabf-09a4e1ba41a1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:51.777615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1d86fdf-ed36-4fed-aabf-09a4e1ba41a1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:51.778356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1d86fdf-ed36-4fed-aabf-09a4e1ba41a1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:51.778784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1d86fdf-ed36-4fed-aabf-09a4e1ba41a1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:51.838191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d1d86fdf-ed36-4fed-aabf-09a4e1ba41a1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:51.845669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d1d86fdf-ed36-4fed-aabf-09a4e1ba41a1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079436 Jul 27 20:32:51.846229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 688/1411] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:52.866592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a26e9c80-8679-48ea-a92f-84507a81ca29 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:52.867202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a26e9c80-8679-48ea-a92f-84507a81ca29 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:52.873999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a26e9c80-8679-48ea-a92f-84507a81ca29 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:52.874450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a26e9c80-8679-48ea-a92f-84507a81ca29 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:52.875205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a26e9c80-8679-48ea-a92f-84507a81ca29 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:52.875639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a26e9c80-8679-48ea-a92f-84507a81ca29 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:52.937800 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a26e9c80-8679-48ea-a92f-84507a81ca29 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:52.945284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a26e9c80-8679-48ea-a92f-84507a81ca29 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083306 Jul 27 20:32:52.945853 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 724/1412] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:53.966018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9f148046-23a0-4764-a5be-77cf5f103aee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:53.966632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9f148046-23a0-4764-a5be-77cf5f103aee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:53.973090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9f148046-23a0-4764-a5be-77cf5f103aee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:53.973542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9f148046-23a0-4764-a5be-77cf5f103aee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:53.974296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9f148046-23a0-4764-a5be-77cf5f103aee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:53.974733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9f148046-23a0-4764-a5be-77cf5f103aee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:54.037689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9f148046-23a0-4764-a5be-77cf5f103aee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:54.045237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9f148046-23a0-4764-a5be-77cf5f103aee tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083197 Jul 27 20:32:54.045808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 689/1413] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:55.066858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e9acaf4d-9f4e-4064-8433-54c0eb3b529d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:55.067468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e9acaf4d-9f4e-4064-8433-54c0eb3b529d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:55.073680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9acaf4d-9f4e-4064-8433-54c0eb3b529d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:55.074127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9acaf4d-9f4e-4064-8433-54c0eb3b529d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:55.074873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9acaf4d-9f4e-4064-8433-54c0eb3b529d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:55.075301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9acaf4d-9f4e-4064-8433-54c0eb3b529d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:55.134917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e9acaf4d-9f4e-4064-8433-54c0eb3b529d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:55.142458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e9acaf4d-9f4e-4064-8433-54c0eb3b529d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079908 Jul 27 20:32:55.143027 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 725/1414] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:56.163547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ef8ad97d-d96b-4ce5-a435-4cd2f2ec1ac5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:56.164230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ef8ad97d-d96b-4ce5-a435-4cd2f2ec1ac5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:56.170747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef8ad97d-d96b-4ce5-a435-4cd2f2ec1ac5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:56.171193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef8ad97d-d96b-4ce5-a435-4cd2f2ec1ac5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:56.171944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef8ad97d-d96b-4ce5-a435-4cd2f2ec1ac5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:56.172401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef8ad97d-d96b-4ce5-a435-4cd2f2ec1ac5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:56.231667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ef8ad97d-d96b-4ce5-a435-4cd2f2ec1ac5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:56.239395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ef8ad97d-d96b-4ce5-a435-4cd2f2ec1ac5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079807 Jul 27 20:32:56.239959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 690/1415] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:57.260085 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-efdd9cc1-834d-4c81-97ca-f08173de5ecc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:57.260715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-efdd9cc1-834d-4c81-97ca-f08173de5ecc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:57.267264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-efdd9cc1-834d-4c81-97ca-f08173de5ecc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:57.267719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-efdd9cc1-834d-4c81-97ca-f08173de5ecc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:57.268498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-efdd9cc1-834d-4c81-97ca-f08173de5ecc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:57.268931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-efdd9cc1-834d-4c81-97ca-f08173de5ecc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:57.329032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-efdd9cc1-834d-4c81-97ca-f08173de5ecc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:57.337202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-efdd9cc1-834d-4c81-97ca-f08173de5ecc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080925 Jul 27 20:32:57.337777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 726/1416] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:58.358203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fba9b66c-f8ea-4594-ad44-ee0d3893bdc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:58.358814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fba9b66c-f8ea-4594-ad44-ee0d3893bdc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:58.366083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fba9b66c-f8ea-4594-ad44-ee0d3893bdc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:58.366527 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fba9b66c-f8ea-4594-ad44-ee0d3893bdc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:58.367279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fba9b66c-f8ea-4594-ad44-ee0d3893bdc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:58.367710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fba9b66c-f8ea-4594-ad44-ee0d3893bdc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:58.430720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fba9b66c-f8ea-4594-ad44-ee0d3893bdc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:58.438266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fba9b66c-f8ea-4594-ad44-ee0d3893bdc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083939 Jul 27 20:32:58.438833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 691/1417] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:59.458855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1c699875-e6c0-48b2-9f2f-8a5139d76a8d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:59.459453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1c699875-e6c0-48b2-9f2f-8a5139d76a8d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:59.465880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c699875-e6c0-48b2-9f2f-8a5139d76a8d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:59.466314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c699875-e6c0-48b2-9f2f-8a5139d76a8d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:59.467061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c699875-e6c0-48b2-9f2f-8a5139d76a8d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:59.467484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c699875-e6c0-48b2-9f2f-8a5139d76a8d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:59.529806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1c699875-e6c0-48b2-9f2f-8a5139d76a8d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:59.537912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1c699875-e6c0-48b2-9f2f-8a5139d76a8d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083043 Jul 27 20:32:59.538474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 727/1418] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:59 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:00.558946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-76d1eb32-5203-4501-98c7-3504397d6967 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:00.559484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-76d1eb32-5203-4501-98c7-3504397d6967 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:00.565909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76d1eb32-5203-4501-98c7-3504397d6967 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:00.566349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76d1eb32-5203-4501-98c7-3504397d6967 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:00.567093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76d1eb32-5203-4501-98c7-3504397d6967 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:00.567515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76d1eb32-5203-4501-98c7-3504397d6967 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:00.630127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-76d1eb32-5203-4501-98c7-3504397d6967 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:00.637489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-76d1eb32-5203-4501-98c7-3504397d6967 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082473 Jul 27 20:33:00.638053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 692/1419] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:01.657601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5fcbba97-9264-4577-bbdb-e78574a5646d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:01.658118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5fcbba97-9264-4577-bbdb-e78574a5646d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:01.665310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fcbba97-9264-4577-bbdb-e78574a5646d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:01.665760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fcbba97-9264-4577-bbdb-e78574a5646d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:01.666517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fcbba97-9264-4577-bbdb-e78574a5646d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:01.666957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fcbba97-9264-4577-bbdb-e78574a5646d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:01.727062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5fcbba97-9264-4577-bbdb-e78574a5646d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:01.734577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5fcbba97-9264-4577-bbdb-e78574a5646d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080945 Jul 27 20:33:01.735147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 728/1420] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:01 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:02.755402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-036cc406-3395-4a93-8185-a70cbdd82ff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:02.756023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-036cc406-3395-4a93-8185-a70cbdd82ff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:02.762463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-036cc406-3395-4a93-8185-a70cbdd82ff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:02.765597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-036cc406-3395-4a93-8185-a70cbdd82ff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:02.765597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-036cc406-3395-4a93-8185-a70cbdd82ff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:02.765597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-036cc406-3395-4a93-8185-a70cbdd82ff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:02.826897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-036cc406-3395-4a93-8185-a70cbdd82ff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:02.834410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-036cc406-3395-4a93-8185-a70cbdd82ff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082889 Jul 27 20:33:02.842518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 693/1421] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:02 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:03.856612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3c2c80e2-642a-433a-aed6-bb99d79e32bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:03.857725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3c2c80e2-642a-433a-aed6-bb99d79e32bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:03.860659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=34 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:03.865562 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c2c80e2-642a-433a-aed6-bb99d79e32bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:03.866012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c2c80e2-642a-433a-aed6-bb99d79e32bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:03.866756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c2c80e2-642a-433a-aed6-bb99d79e32bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:03.867181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c2c80e2-642a-433a-aed6-bb99d79e32bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:03.928691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3c2c80e2-642a-433a-aed6-bb99d79e32bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:03.936072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3c2c80e2-642a-433a-aed6-bb99d79e32bb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084491 Jul 27 20:33:03.936682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 729/1422] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:04.957308 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b0cbc92d-9ae6-4138-b3ca-ed8f4ac5ebba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:04.957854 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b0cbc92d-9ae6-4138-b3ca-ed8f4ac5ebba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:04.960106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=34 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:04.964810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0cbc92d-9ae6-4138-b3ca-ed8f4ac5ebba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:04.965286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0cbc92d-9ae6-4138-b3ca-ed8f4ac5ebba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:04.966032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0cbc92d-9ae6-4138-b3ca-ed8f4ac5ebba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:04.966486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0cbc92d-9ae6-4138-b3ca-ed8f4ac5ebba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:05.030159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b0cbc92d-9ae6-4138-b3ca-ed8f4ac5ebba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:05.037553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b0cbc92d-9ae6-4138-b3ca-ed8f4ac5ebba tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084779 Jul 27 20:33:05.038126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 694/1423] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:06.058077 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f14c5463-2ff1-4b63-b7b6-b832f43e763b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:06.058717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f14c5463-2ff1-4b63-b7b6-b832f43e763b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:06.065248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f14c5463-2ff1-4b63-b7b6-b832f43e763b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:06.066317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f14c5463-2ff1-4b63-b7b6-b832f43e763b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:06.067088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f14c5463-2ff1-4b63-b7b6-b832f43e763b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:06.067523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f14c5463-2ff1-4b63-b7b6-b832f43e763b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:06.129498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f14c5463-2ff1-4b63-b7b6-b832f43e763b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:06.136940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f14c5463-2ff1-4b63-b7b6-b832f43e763b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082736 Jul 27 20:33:06.137515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 730/1424] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:07.157691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-50c0a477-6d98-4d19-abe2-4045a26d6d57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:07.158307 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-50c0a477-6d98-4d19-abe2-4045a26d6d57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:07.165307 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-50c0a477-6d98-4d19-abe2-4045a26d6d57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:07.165761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-50c0a477-6d98-4d19-abe2-4045a26d6d57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:07.166519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-50c0a477-6d98-4d19-abe2-4045a26d6d57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:07.166956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-50c0a477-6d98-4d19-abe2-4045a26d6d57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:07.229683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-50c0a477-6d98-4d19-abe2-4045a26d6d57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:07.237103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-50c0a477-6d98-4d19-abe2-4045a26d6d57 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083279 Jul 27 20:33:07.238213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 695/1425] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:08.259576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6a4049ca-fd91-4cf6-b390-360a51ececcc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:08.260180 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6a4049ca-fd91-4cf6-b390-360a51ececcc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:08.266611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a4049ca-fd91-4cf6-b390-360a51ececcc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:08.267054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a4049ca-fd91-4cf6-b390-360a51ececcc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:08.267835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a4049ca-fd91-4cf6-b390-360a51ececcc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:08.268267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a4049ca-fd91-4cf6-b390-360a51ececcc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:08.328340 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6a4049ca-fd91-4cf6-b390-360a51ececcc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:08.335863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6a4049ca-fd91-4cf6-b390-360a51ececcc tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080256 Jul 27 20:33:08.336462 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 731/1426] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:08 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:09.356395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-97f369c6-c53c-4bd7-bf1a-7d10ff4289b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:09.357017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-97f369c6-c53c-4bd7-bf1a-7d10ff4289b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:09.364110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97f369c6-c53c-4bd7-bf1a-7d10ff4289b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:09.364585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97f369c6-c53c-4bd7-bf1a-7d10ff4289b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:09.365337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97f369c6-c53c-4bd7-bf1a-7d10ff4289b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:09.365769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97f369c6-c53c-4bd7-bf1a-7d10ff4289b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:09.368263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=87 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:09.426640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-97f369c6-c53c-4bd7-bf1a-7d10ff4289b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:09.434025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-97f369c6-c53c-4bd7-bf1a-7d10ff4289b4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081485 Jul 27 20:33:09.434615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 696/1427] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:09 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:10.454759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-debd4456-0f33-45aa-a5d6-f9254ac51eb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:10.455371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-debd4456-0f33-45aa-a5d6-f9254ac51eb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:10.462396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-debd4456-0f33-45aa-a5d6-f9254ac51eb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:10.462843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-debd4456-0f33-45aa-a5d6-f9254ac51eb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:10.463603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-debd4456-0f33-45aa-a5d6-f9254ac51eb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:10.464072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-debd4456-0f33-45aa-a5d6-f9254ac51eb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:10.523880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-debd4456-0f33-45aa-a5d6-f9254ac51eb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:10.531455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-debd4456-0f33-45aa-a5d6-f9254ac51eb8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080697 Jul 27 20:33:10.531961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 732/1428] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:11.553263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0643d58e-72d7-4176-b904-8bb0dff8c066 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:11.553871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0643d58e-72d7-4176-b904-8bb0dff8c066 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:11.560318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0643d58e-72d7-4176-b904-8bb0dff8c066 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:11.560795 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0643d58e-72d7-4176-b904-8bb0dff8c066 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:11.561546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0643d58e-72d7-4176-b904-8bb0dff8c066 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:11.561975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0643d58e-72d7-4176-b904-8bb0dff8c066 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:11.625829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0643d58e-72d7-4176-b904-8bb0dff8c066 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:11.633156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0643d58e-72d7-4176-b904-8bb0dff8c066 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084250 Jul 27 20:33:11.633712 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 697/1429] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:12.654048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8b20d474-9d29-445a-976c-f336f968b07a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:12.654575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8b20d474-9d29-445a-976c-f336f968b07a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:12.661553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b20d474-9d29-445a-976c-f336f968b07a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:12.662004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b20d474-9d29-445a-976c-f336f968b07a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:12.662759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b20d474-9d29-445a-976c-f336f968b07a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:12.663192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b20d474-9d29-445a-976c-f336f968b07a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:12.725008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8b20d474-9d29-445a-976c-f336f968b07a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:12.732618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8b20d474-9d29-445a-976c-f336f968b07a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082497 Jul 27 20:33:12.733184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 733/1430] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:13.753446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5bd5f7ee-e664-4ea8-b010-a7af5e98b812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:13.754049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5bd5f7ee-e664-4ea8-b010-a7af5e98b812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:13.760833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5bd5f7ee-e664-4ea8-b010-a7af5e98b812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:13.761274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5bd5f7ee-e664-4ea8-b010-a7af5e98b812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:13.762022 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5bd5f7ee-e664-4ea8-b010-a7af5e98b812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:13.762446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5bd5f7ee-e664-4ea8-b010-a7af5e98b812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:13.823195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5bd5f7ee-e664-4ea8-b010-a7af5e98b812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:13.830675 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5bd5f7ee-e664-4ea8-b010-a7af5e98b812 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081159 Jul 27 20:33:13.831903 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 698/1431] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:14.852538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eae65772-8bde-4594-85a8-12826a201fa7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:14.853176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eae65772-8bde-4594-85a8-12826a201fa7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:14.859513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eae65772-8bde-4594-85a8-12826a201fa7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:14.859961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eae65772-8bde-4594-85a8-12826a201fa7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:14.860728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eae65772-8bde-4594-85a8-12826a201fa7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:14.861150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eae65772-8bde-4594-85a8-12826a201fa7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:14.923594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eae65772-8bde-4594-85a8-12826a201fa7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:14.931464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eae65772-8bde-4594-85a8-12826a201fa7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082835 Jul 27 20:33:14.932037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 734/1432] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:15.952192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7248e518-f096-4920-bc92-67867dbdcf7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:15.952855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7248e518-f096-4920-bc92-67867dbdcf7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:15.959446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7248e518-f096-4920-bc92-67867dbdcf7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:15.959891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7248e518-f096-4920-bc92-67867dbdcf7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:15.960684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7248e518-f096-4920-bc92-67867dbdcf7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:15.961111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7248e518-f096-4920-bc92-67867dbdcf7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:16.025779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7248e518-f096-4920-bc92-67867dbdcf7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:16.033292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7248e518-f096-4920-bc92-67867dbdcf7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084991 Jul 27 20:33:16.033866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 699/1433] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:15 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:17.054673 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e9ee221b-2d0e-43bf-8673-bd62f35a1867 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:17.055283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e9ee221b-2d0e-43bf-8673-bd62f35a1867 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:17.061757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9ee221b-2d0e-43bf-8673-bd62f35a1867 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.062202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9ee221b-2d0e-43bf-8673-bd62f35a1867 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.062951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9ee221b-2d0e-43bf-8673-bd62f35a1867 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.063380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e9ee221b-2d0e-43bf-8673-bd62f35a1867 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.123995 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e9ee221b-2d0e-43bf-8673-bd62f35a1867 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:17.131467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e9ee221b-2d0e-43bf-8673-bd62f35a1867 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081365 Jul 27 20:33:17.132043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 735/1434] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:18.151438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dee36525-9b6b-43f8-8f85-8c415abfa38f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:18.152039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dee36525-9b6b-43f8-8f85-8c415abfa38f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:18.158447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dee36525-9b6b-43f8-8f85-8c415abfa38f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:18.158887 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dee36525-9b6b-43f8-8f85-8c415abfa38f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:18.160198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dee36525-9b6b-43f8-8f85-8c415abfa38f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:18.160683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dee36525-9b6b-43f8-8f85-8c415abfa38f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:18.282674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dee36525-9b6b-43f8-8f85-8c415abfa38f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:18.290744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dee36525-9b6b-43f8-8f85-8c415abfa38f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.143197 Jul 27 20:33:18.291334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 700/1435] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:19.311066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5de2c7a2-490e-4c45-a44b-dade89c3f88c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:19.311679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5de2c7a2-490e-4c45-a44b-dade89c3f88c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:19.318149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de2c7a2-490e-4c45-a44b-dade89c3f88c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:19.318595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de2c7a2-490e-4c45-a44b-dade89c3f88c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:19.319344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de2c7a2-490e-4c45-a44b-dade89c3f88c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:19.319781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de2c7a2-490e-4c45-a44b-dade89c3f88c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:19.323633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=83 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:19.426781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5de2c7a2-490e-4c45-a44b-dade89c3f88c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:19.434200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5de2c7a2-490e-4c45-a44b-dade89c3f88c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.127031 Jul 27 20:33:19.434768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 736/1436] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:20.455149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2a1121b2-726e-4d82-901b-43998847023b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:20.455840 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2a1121b2-726e-4d82-901b-43998847023b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:20.462885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a1121b2-726e-4d82-901b-43998847023b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:20.467185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a1121b2-726e-4d82-901b-43998847023b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:20.467185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a1121b2-726e-4d82-901b-43998847023b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:20.467185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a1121b2-726e-4d82-901b-43998847023b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:20.526844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2a1121b2-726e-4d82-901b-43998847023b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:20.534988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2a1121b2-726e-4d82-901b-43998847023b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083092 Jul 27 20:33:20.535486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 701/1437] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:21.556097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7b9da9c5-0f6a-411e-88e8-81867e61b0a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:21.556757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7b9da9c5-0f6a-411e-88e8-81867e61b0a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:21.563183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b9da9c5-0f6a-411e-88e8-81867e61b0a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:21.563622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b9da9c5-0f6a-411e-88e8-81867e61b0a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:21.564361 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b9da9c5-0f6a-411e-88e8-81867e61b0a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:21.564810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b9da9c5-0f6a-411e-88e8-81867e61b0a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:21.624207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7b9da9c5-0f6a-411e-88e8-81867e61b0a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:21.631644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7b9da9c5-0f6a-411e-88e8-81867e61b0a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079455 Jul 27 20:33:21.632212 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 737/1438] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:22.651831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fcac69c6-547a-4075-8ac1-8c53141d64fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:22.652362 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fcac69c6-547a-4075-8ac1-8c53141d64fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:22.658827 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fcac69c6-547a-4075-8ac1-8c53141d64fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:22.659276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fcac69c6-547a-4075-8ac1-8c53141d64fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:22.660032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fcac69c6-547a-4075-8ac1-8c53141d64fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:22.660498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fcac69c6-547a-4075-8ac1-8c53141d64fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:22.720267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fcac69c6-547a-4075-8ac1-8c53141d64fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:22.727698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fcac69c6-547a-4075-8ac1-8c53141d64fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079814 Jul 27 20:33:22.728267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 702/1439] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:23.748963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6e1f4d30-e2e0-4059-a0ea-3d6c191442e3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:23.749571 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6e1f4d30-e2e0-4059-a0ea-3d6c191442e3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:23.756097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e1f4d30-e2e0-4059-a0ea-3d6c191442e3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:23.756589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e1f4d30-e2e0-4059-a0ea-3d6c191442e3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:23.757341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e1f4d30-e2e0-4059-a0ea-3d6c191442e3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:23.757772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e1f4d30-e2e0-4059-a0ea-3d6c191442e3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:23.817722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6e1f4d30-e2e0-4059-a0ea-3d6c191442e3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:23.825070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6e1f4d30-e2e0-4059-a0ea-3d6c191442e3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080218 Jul 27 20:33:23.825630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 738/1440] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:24.844932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-db4e51cc-b437-4b98-9925-8a13e7bc9eed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:24.845533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-db4e51cc-b437-4b98-9925-8a13e7bc9eed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:24.851876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db4e51cc-b437-4b98-9925-8a13e7bc9eed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:24.852318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db4e51cc-b437-4b98-9925-8a13e7bc9eed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:24.853090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db4e51cc-b437-4b98-9925-8a13e7bc9eed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:24.853515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db4e51cc-b437-4b98-9925-8a13e7bc9eed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:24.916208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-db4e51cc-b437-4b98-9925-8a13e7bc9eed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:24.923944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-db4e51cc-b437-4b98-9925-8a13e7bc9eed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082858 Jul 27 20:33:24.925019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 703/1441] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:25.945026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-df96b23d-6e4d-49cb-bccf-e85cc4c4c9f1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:25.945626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-df96b23d-6e4d-49cb-bccf-e85cc4c4c9f1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:25.951577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df96b23d-6e4d-49cb-bccf-e85cc4c4c9f1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:25.952017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df96b23d-6e4d-49cb-bccf-e85cc4c4c9f1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:25.952780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df96b23d-6e4d-49cb-bccf-e85cc4c4c9f1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:25.953206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df96b23d-6e4d-49cb-bccf-e85cc4c4c9f1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:26.020317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-df96b23d-6e4d-49cb-bccf-e85cc4c4c9f1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:26.027666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-df96b23d-6e4d-49cb-bccf-e85cc4c4c9f1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.087137 Jul 27 20:33:26.028255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 739/1442] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:27.048106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-900fee9d-7634-4043-83d2-2cde724d04d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:27.048737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-900fee9d-7634-4043-83d2-2cde724d04d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:27.055217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-900fee9d-7634-4043-83d2-2cde724d04d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:27.055670 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-900fee9d-7634-4043-83d2-2cde724d04d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:27.056440 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-900fee9d-7634-4043-83d2-2cde724d04d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:27.056873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-900fee9d-7634-4043-83d2-2cde724d04d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:27.116666 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-900fee9d-7634-4043-83d2-2cde724d04d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:27.124213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-900fee9d-7634-4043-83d2-2cde724d04d2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080001 Jul 27 20:33:27.124808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 704/1443] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:27 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:28.144615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c288717d-1dcd-465b-840a-e19fa88051e7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:28.145284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c288717d-1dcd-465b-840a-e19fa88051e7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:28.151655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c288717d-1dcd-465b-840a-e19fa88051e7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:28.152106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c288717d-1dcd-465b-840a-e19fa88051e7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:28.152885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c288717d-1dcd-465b-840a-e19fa88051e7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:28.153321 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c288717d-1dcd-465b-840a-e19fa88051e7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:28.212920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c288717d-1dcd-465b-840a-e19fa88051e7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:28.220261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c288717d-1dcd-465b-840a-e19fa88051e7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080184 Jul 27 20:33:28.220856 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 740/1444] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:29.240995 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c6e152d4-b5b5-46c0-a0e2-82e24d369b42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:29.241581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c6e152d4-b5b5-46c0-a0e2-82e24d369b42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:29.245912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:33:29.246373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:33:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:33:29.248268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6e152d4-b5b5-46c0-a0e2-82e24d369b42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:29.248741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6e152d4-b5b5-46c0-a0e2-82e24d369b42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:29.249508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6e152d4-b5b5-46c0-a0e2-82e24d369b42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:29.249917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6e152d4-b5b5-46c0-a0e2-82e24d369b42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:29.314655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c6e152d4-b5b5-46c0-a0e2-82e24d369b42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:29.322111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c6e152d4-b5b5-46c0-a0e2-82e24d369b42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085093 Jul 27 20:33:29.322688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 705/1445] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:29.841234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:33:29.841473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:33:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:33:30.343054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-81938e05-fb56-41e9-afa7-16c8aaa34846 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:30.343668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-81938e05-fb56-41e9-afa7-16c8aaa34846 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:30.350371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81938e05-fb56-41e9-afa7-16c8aaa34846 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:30.355333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81938e05-fb56-41e9-afa7-16c8aaa34846 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:30.355333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81938e05-fb56-41e9-afa7-16c8aaa34846 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:30.355333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81938e05-fb56-41e9-afa7-16c8aaa34846 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:30.413435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-81938e05-fb56-41e9-afa7-16c8aaa34846 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:30.420984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-81938e05-fb56-41e9-afa7-16c8aaa34846 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081836 Jul 27 20:33:30.421707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 741/1446] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:31.442204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a97c7016-5487-4132-b32d-1ad0fe18af36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:31.442814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a97c7016-5487-4132-b32d-1ad0fe18af36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:31.449356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a97c7016-5487-4132-b32d-1ad0fe18af36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:31.449804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a97c7016-5487-4132-b32d-1ad0fe18af36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:31.450555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a97c7016-5487-4132-b32d-1ad0fe18af36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:31.450985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a97c7016-5487-4132-b32d-1ad0fe18af36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:31.511963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a97c7016-5487-4132-b32d-1ad0fe18af36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:31.519651 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a97c7016-5487-4132-b32d-1ad0fe18af36 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081903 Jul 27 20:33:31.520217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 706/1447] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:32.540391 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e308ebe1-778b-4dca-b253-89b27a25ac0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:32.541013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e308ebe1-778b-4dca-b253-89b27a25ac0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:32.547369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e308ebe1-778b-4dca-b253-89b27a25ac0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:32.547810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e308ebe1-778b-4dca-b253-89b27a25ac0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:32.548594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e308ebe1-778b-4dca-b253-89b27a25ac0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:32.549016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e308ebe1-778b-4dca-b253-89b27a25ac0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:32.608208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e308ebe1-778b-4dca-b253-89b27a25ac0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:32.615603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e308ebe1-778b-4dca-b253-89b27a25ac0f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.078999 Jul 27 20:33:32.616186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 742/1448] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:33.636994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-49807f4e-0df8-42d7-a885-7d6ed8146ed7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:33.637528 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-49807f4e-0df8-42d7-a885-7d6ed8146ed7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:33.644043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49807f4e-0df8-42d7-a885-7d6ed8146ed7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:33.644581 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49807f4e-0df8-42d7-a885-7d6ed8146ed7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:33.645339 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49807f4e-0df8-42d7-a885-7d6ed8146ed7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:33.645777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49807f4e-0df8-42d7-a885-7d6ed8146ed7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:33.708928 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-49807f4e-0df8-42d7-a885-7d6ed8146ed7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:33.716281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-49807f4e-0df8-42d7-a885-7d6ed8146ed7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083170 Jul 27 20:33:33.716876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 707/1449] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:33 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:34.737720 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-09e13c12-daf8-4fb6-a881-73bfb381382b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:34.738420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-09e13c12-daf8-4fb6-a881-73bfb381382b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:34.740805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:34.745745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09e13c12-daf8-4fb6-a881-73bfb381382b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:34.746190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09e13c12-daf8-4fb6-a881-73bfb381382b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:34.747034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09e13c12-daf8-4fb6-a881-73bfb381382b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:34.747380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09e13c12-daf8-4fb6-a881-73bfb381382b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:34.841745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-09e13c12-daf8-4fb6-a881-73bfb381382b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:34.849190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-09e13c12-daf8-4fb6-a881-73bfb381382b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.115484 Jul 27 20:33:34.849767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 743/1450] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:35.869956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-72f3796b-c189-4ce5-ba90-72cee1ae8f41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:35.870587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-72f3796b-c189-4ce5-ba90-72cee1ae8f41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:35.872932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=28 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:35.877689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-72f3796b-c189-4ce5-ba90-72cee1ae8f41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:35.878665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-72f3796b-c189-4ce5-ba90-72cee1ae8f41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:35.879465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-72f3796b-c189-4ce5-ba90-72cee1ae8f41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:35.879904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-72f3796b-c189-4ce5-ba90-72cee1ae8f41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:35.942245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-72f3796b-c189-4ce5-ba90-72cee1ae8f41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:35.950036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-72f3796b-c189-4ce5-ba90-72cee1ae8f41 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084321 Jul 27 20:33:35.950826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 708/1451] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:35 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:36.970170 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-01b9fcf9-fc97-4872-ac13-3ee588794663 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:36.970782 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-01b9fcf9-fc97-4872-ac13-3ee588794663 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:36.977920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01b9fcf9-fc97-4872-ac13-3ee588794663 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:36.978367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01b9fcf9-fc97-4872-ac13-3ee588794663 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:36.979121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01b9fcf9-fc97-4872-ac13-3ee588794663 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:36.979554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01b9fcf9-fc97-4872-ac13-3ee588794663 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:37.042055 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-01b9fcf9-fc97-4872-ac13-3ee588794663 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:37.049510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-01b9fcf9-fc97-4872-ac13-3ee588794663 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083220 Jul 27 20:33:37.050086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 744/1452] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:38.070275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f3b86a0a-2ed4-4cc0-a64d-fd9bb9bda1cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:38.070912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f3b86a0a-2ed4-4cc0-a64d-fd9bb9bda1cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:38.077423 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3b86a0a-2ed4-4cc0-a64d-fd9bb9bda1cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:38.077874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3b86a0a-2ed4-4cc0-a64d-fd9bb9bda1cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:38.078622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3b86a0a-2ed4-4cc0-a64d-fd9bb9bda1cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:38.079057 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3b86a0a-2ed4-4cc0-a64d-fd9bb9bda1cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:38.138351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f3b86a0a-2ed4-4cc0-a64d-fd9bb9bda1cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:38.145889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f3b86a0a-2ed4-4cc0-a64d-fd9bb9bda1cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079600 Jul 27 20:33:38.146448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 709/1453] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:39.166594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c4ce8d84-445c-4fe9-b2b1-083f9ae7008d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:39.167198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c4ce8d84-445c-4fe9-b2b1-083f9ae7008d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:39.173694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4ce8d84-445c-4fe9-b2b1-083f9ae7008d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:39.174146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4ce8d84-445c-4fe9-b2b1-083f9ae7008d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:39.175399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4ce8d84-445c-4fe9-b2b1-083f9ae7008d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:39.175829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4ce8d84-445c-4fe9-b2b1-083f9ae7008d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:39.235494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c4ce8d84-445c-4fe9-b2b1-083f9ae7008d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:39.243294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c4ce8d84-445c-4fe9-b2b1-083f9ae7008d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080594 Jul 27 20:33:39.243844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 745/1454] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:40.264850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ee5beaa9-bdbc-45a7-8834-cb6bdf533a1c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:40.265431 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ee5beaa9-bdbc-45a7-8834-cb6bdf533a1c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:40.271818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee5beaa9-bdbc-45a7-8834-cb6bdf533a1c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:40.272258 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee5beaa9-bdbc-45a7-8834-cb6bdf533a1c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:40.273042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee5beaa9-bdbc-45a7-8834-cb6bdf533a1c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:40.273466 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee5beaa9-bdbc-45a7-8834-cb6bdf533a1c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:40.275928 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=84 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:40.335723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ee5beaa9-bdbc-45a7-8834-cb6bdf533a1c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:40.343263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ee5beaa9-bdbc-45a7-8834-cb6bdf533a1c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082253 Jul 27 20:33:40.343827 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 710/1455] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:40 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:41.364299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-40e1c165-f18d-4963-8003-2dd247168d39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:41.364961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-40e1c165-f18d-4963-8003-2dd247168d39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:41.371828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40e1c165-f18d-4963-8003-2dd247168d39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:41.372277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40e1c165-f18d-4963-8003-2dd247168d39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:41.373070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40e1c165-f18d-4963-8003-2dd247168d39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:41.373504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-40e1c165-f18d-4963-8003-2dd247168d39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:41.436044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-40e1c165-f18d-4963-8003-2dd247168d39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:41.443585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-40e1c165-f18d-4963-8003-2dd247168d39 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083222 Jul 27 20:33:41.444150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 746/1456] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:41 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:42.465643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8adf6327-50a9-4cfb-9f09-8550719665b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:42.466246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8adf6327-50a9-4cfb-9f09-8550719665b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:42.473240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8adf6327-50a9-4cfb-9f09-8550719665b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:42.473681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8adf6327-50a9-4cfb-9f09-8550719665b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:42.474423 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8adf6327-50a9-4cfb-9f09-8550719665b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:42.474846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8adf6327-50a9-4cfb-9f09-8550719665b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:42.536280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8adf6327-50a9-4cfb-9f09-8550719665b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:42.543439 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8adf6327-50a9-4cfb-9f09-8550719665b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081645 Jul 27 20:33:42.543994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 711/1457] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:43.564980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c29b4eba-07ae-4922-9fc1-ff5fe93caf8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:43.566146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c29b4eba-07ae-4922-9fc1-ff5fe93caf8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:43.572799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c29b4eba-07ae-4922-9fc1-ff5fe93caf8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:43.576746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c29b4eba-07ae-4922-9fc1-ff5fe93caf8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:43.576746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c29b4eba-07ae-4922-9fc1-ff5fe93caf8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:43.576746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c29b4eba-07ae-4922-9fc1-ff5fe93caf8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:43.634466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c29b4eba-07ae-4922-9fc1-ff5fe93caf8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:43.641959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c29b4eba-07ae-4922-9fc1-ff5fe93caf8f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080970 Jul 27 20:33:43.642527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 747/1458] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:43 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:44.520757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:33:44.521329 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:33:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:33:44.663234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ee0c6a70-f956-40d1-8308-55934a7d496f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:44.663758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ee0c6a70-f956-40d1-8308-55934a7d496f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:44.670046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee0c6a70-f956-40d1-8308-55934a7d496f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:44.673643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee0c6a70-f956-40d1-8308-55934a7d496f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:44.673643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee0c6a70-f956-40d1-8308-55934a7d496f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:44.673643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee0c6a70-f956-40d1-8308-55934a7d496f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:44.732512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ee0c6a70-f956-40d1-8308-55934a7d496f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:44.740101 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ee0c6a70-f956-40d1-8308-55934a7d496f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081284 Jul 27 20:33:44.740715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 712/1459] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:45.761614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1ab31b33-26c6-4a6a-9108-b780b7b49af1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:45.762218 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1ab31b33-26c6-4a6a-9108-b780b7b49af1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:45.769469 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ab31b33-26c6-4a6a-9108-b780b7b49af1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:45.769917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ab31b33-26c6-4a6a-9108-b780b7b49af1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:45.770677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ab31b33-26c6-4a6a-9108-b780b7b49af1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:45.771110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ab31b33-26c6-4a6a-9108-b780b7b49af1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:45.839854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1ab31b33-26c6-4a6a-9108-b780b7b49af1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:45.842891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1ab31b33-26c6-4a6a-9108-b780b7b49af1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085148 Jul 27 20:33:45.843460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 748/1460] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:46.864519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-438c9fdb-3250-4cc7-82c5-912d5a7f7f6a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:46.865133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-438c9fdb-3250-4cc7-82c5-912d5a7f7f6a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:46.871842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-438c9fdb-3250-4cc7-82c5-912d5a7f7f6a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:46.872286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-438c9fdb-3250-4cc7-82c5-912d5a7f7f6a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:46.873065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-438c9fdb-3250-4cc7-82c5-912d5a7f7f6a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:46.873506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-438c9fdb-3250-4cc7-82c5-912d5a7f7f6a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:46.932929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-438c9fdb-3250-4cc7-82c5-912d5a7f7f6a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:46.940734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-438c9fdb-3250-4cc7-82c5-912d5a7f7f6a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079598 Jul 27 20:33:46.941304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 713/1461] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:47.573366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:33:47.573527 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:33:47.962057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d76d7926-ebb2-48ce-b287-bf40a3ad163d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:47.962658 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d76d7926-ebb2-48ce-b287-bf40a3ad163d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:47.969413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d76d7926-ebb2-48ce-b287-bf40a3ad163d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:47.969877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d76d7926-ebb2-48ce-b287-bf40a3ad163d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:47.970622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d76d7926-ebb2-48ce-b287-bf40a3ad163d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:47.971046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d76d7926-ebb2-48ce-b287-bf40a3ad163d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:48.030599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d76d7926-ebb2-48ce-b287-bf40a3ad163d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:48.038669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d76d7926-ebb2-48ce-b287-bf40a3ad163d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080664 Jul 27 20:33:48.039228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 749/1462] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:47 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:49.059131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-917c6955-0e10-44cf-82e0-af5e7d328252 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:49.059743 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-917c6955-0e10-44cf-82e0-af5e7d328252 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:49.066398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-917c6955-0e10-44cf-82e0-af5e7d328252 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:49.067937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-917c6955-0e10-44cf-82e0-af5e7d328252 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:49.067937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-917c6955-0e10-44cf-82e0-af5e7d328252 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:49.068144 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-917c6955-0e10-44cf-82e0-af5e7d328252 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:49.127487 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-917c6955-0e10-44cf-82e0-af5e7d328252 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:49.134861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-917c6955-0e10-44cf-82e0-af5e7d328252 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079605 Jul 27 20:33:49.135421 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 714/1463] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:50.155106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-64a232b3-9510-479e-906a-709248f8040f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:50.155713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-64a232b3-9510-479e-906a-709248f8040f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:50.162169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64a232b3-9510-479e-906a-709248f8040f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:50.162617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64a232b3-9510-479e-906a-709248f8040f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:50.163369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64a232b3-9510-479e-906a-709248f8040f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:50.163806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64a232b3-9510-479e-906a-709248f8040f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:50.166329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=84 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:50.230442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64a232b3-9510-479e-906a-709248f8040f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:50.238495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-64a232b3-9510-479e-906a-709248f8040f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.087293 Jul 27 20:33:50.239118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 750/1464] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:51.259880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-40d25046-b14e-42dd-b291-a36fa14ec9b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:51.260516 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-40d25046-b14e-42dd-b291-a36fa14ec9b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:51.267167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40d25046-b14e-42dd-b291-a36fa14ec9b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:51.267619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40d25046-b14e-42dd-b291-a36fa14ec9b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:51.268399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40d25046-b14e-42dd-b291-a36fa14ec9b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:51.268839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40d25046-b14e-42dd-b291-a36fa14ec9b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:51.328253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-40d25046-b14e-42dd-b291-a36fa14ec9b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:51.335695 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-40d25046-b14e-42dd-b291-a36fa14ec9b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079662 Jul 27 20:33:51.336258 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 715/1465] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:52.356618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0db8e324-db8e-4cff-af21-990ec673c7f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:52.357257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0db8e324-db8e-4cff-af21-990ec673c7f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:52.363682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0db8e324-db8e-4cff-af21-990ec673c7f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:52.364123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0db8e324-db8e-4cff-af21-990ec673c7f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:52.364909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0db8e324-db8e-4cff-af21-990ec673c7f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:52.365336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0db8e324-db8e-4cff-af21-990ec673c7f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:52.424769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0db8e324-db8e-4cff-af21-990ec673c7f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:52.432625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0db8e324-db8e-4cff-af21-990ec673c7f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079852 Jul 27 20:33:52.433191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 751/1466] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:53.453443 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b933287c-42d9-4063-bdd0-bb3af4bf5ead tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:53.454056 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b933287c-42d9-4063-bdd0-bb3af4bf5ead tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:53.460611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b933287c-42d9-4063-bdd0-bb3af4bf5ead tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:53.461068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b933287c-42d9-4063-bdd0-bb3af4bf5ead tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:53.461824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b933287c-42d9-4063-bdd0-bb3af4bf5ead tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:53.462260 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b933287c-42d9-4063-bdd0-bb3af4bf5ead tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:53.523209 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b933287c-42d9-4063-bdd0-bb3af4bf5ead tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:53.530644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b933287c-42d9-4063-bdd0-bb3af4bf5ead tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081045 Jul 27 20:33:53.531209 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 716/1467] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:54.552483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-57f46ed0-d1c4-4ff9-8b49-c2e1573995ca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:54.553028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-57f46ed0-d1c4-4ff9-8b49-c2e1573995ca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:54.559464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57f46ed0-d1c4-4ff9-8b49-c2e1573995ca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:54.559904 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57f46ed0-d1c4-4ff9-8b49-c2e1573995ca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:54.560703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57f46ed0-d1c4-4ff9-8b49-c2e1573995ca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:54.561131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-57f46ed0-d1c4-4ff9-8b49-c2e1573995ca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:54.622587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-57f46ed0-d1c4-4ff9-8b49-c2e1573995ca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:54.629968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-57f46ed0-d1c4-4ff9-8b49-c2e1573995ca tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082026 Jul 27 20:33:54.630528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 752/1468] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:54 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:55.650291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-326cef2b-5bbf-46af-bc0b-4e16f40a4cc7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:55.650842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-326cef2b-5bbf-46af-bc0b-4e16f40a4cc7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:55.657267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-326cef2b-5bbf-46af-bc0b-4e16f40a4cc7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:55.657716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-326cef2b-5bbf-46af-bc0b-4e16f40a4cc7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:55.658469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-326cef2b-5bbf-46af-bc0b-4e16f40a4cc7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:55.658901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-326cef2b-5bbf-46af-bc0b-4e16f40a4cc7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:55.718241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-326cef2b-5bbf-46af-bc0b-4e16f40a4cc7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:55.726261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-326cef2b-5bbf-46af-bc0b-4e16f40a4cc7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079912 Jul 27 20:33:55.726822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 717/1469] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:56.747150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4a57621e-b775-4e31-9cdf-fe400bdb501e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:56.747766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4a57621e-b775-4e31-9cdf-fe400bdb501e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:56.754486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a57621e-b775-4e31-9cdf-fe400bdb501e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:56.754938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a57621e-b775-4e31-9cdf-fe400bdb501e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:56.755694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a57621e-b775-4e31-9cdf-fe400bdb501e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:56.756131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a57621e-b775-4e31-9cdf-fe400bdb501e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:56.815044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4a57621e-b775-4e31-9cdf-fe400bdb501e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:56.822903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4a57621e-b775-4e31-9cdf-fe400bdb501e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079956 Jul 27 20:33:56.823459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 753/1470] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:57.843493 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-53c935ad-6b83-461e-8f88-99a775ca2264 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:57.844124 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-53c935ad-6b83-461e-8f88-99a775ca2264 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:57.850537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-53c935ad-6b83-461e-8f88-99a775ca2264 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:57.850984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-53c935ad-6b83-461e-8f88-99a775ca2264 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:57.852115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-53c935ad-6b83-461e-8f88-99a775ca2264 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:57.852923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-53c935ad-6b83-461e-8f88-99a775ca2264 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:57.916703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-53c935ad-6b83-461e-8f88-99a775ca2264 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:57.924146 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-53c935ad-6b83-461e-8f88-99a775ca2264 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084611 Jul 27 20:33:57.924747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 718/1471] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:58.945882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d3b68ac8-92ea-4db2-8c32-bef4769d6997 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:58.946496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d3b68ac8-92ea-4db2-8c32-bef4769d6997 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:58.953071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3b68ac8-92ea-4db2-8c32-bef4769d6997 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:58.953527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3b68ac8-92ea-4db2-8c32-bef4769d6997 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:58.954285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3b68ac8-92ea-4db2-8c32-bef4769d6997 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:58.954753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3b68ac8-92ea-4db2-8c32-bef4769d6997 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:59.017195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d3b68ac8-92ea-4db2-8c32-bef4769d6997 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:59.025278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d3b68ac8-92ea-4db2-8c32-bef4769d6997 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083415 Jul 27 20:33:59.025849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 754/1472] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:00.045761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c2ed84e9-91c6-4e62-a898-2063827a4b44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:00.046392 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c2ed84e9-91c6-4e62-a898-2063827a4b44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:00.053301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2ed84e9-91c6-4e62-a898-2063827a4b44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:00.053739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2ed84e9-91c6-4e62-a898-2063827a4b44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:00.054480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2ed84e9-91c6-4e62-a898-2063827a4b44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:00.054901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2ed84e9-91c6-4e62-a898-2063827a4b44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:00.263541 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c2ed84e9-91c6-4e62-a898-2063827a4b44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:00.270824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c2ed84e9-91c6-4e62-a898-2063827a4b44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.228919 Jul 27 20:34:00.271372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 719/1473] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:01.291228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-203d2626-a565-4047-83d1-58e1cf49a03d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:01.291845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-203d2626-a565-4047-83d1-58e1cf49a03d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:01.298315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-203d2626-a565-4047-83d1-58e1cf49a03d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:01.298759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-203d2626-a565-4047-83d1-58e1cf49a03d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:01.299510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-203d2626-a565-4047-83d1-58e1cf49a03d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:01.299941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-203d2626-a565-4047-83d1-58e1cf49a03d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:01.359746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-203d2626-a565-4047-83d1-58e1cf49a03d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:01.367631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-203d2626-a565-4047-83d1-58e1cf49a03d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080293 Jul 27 20:34:01.368196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 755/1474] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:01 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:02.388907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-757a2474-8513-4074-aa47-cb89831f5316 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:02.389523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-757a2474-8513-4074-aa47-cb89831f5316 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:02.396680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-757a2474-8513-4074-aa47-cb89831f5316 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:02.397132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-757a2474-8513-4074-aa47-cb89831f5316 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:02.397886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-757a2474-8513-4074-aa47-cb89831f5316 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:02.398320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-757a2474-8513-4074-aa47-cb89831f5316 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:02.462788 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-757a2474-8513-4074-aa47-cb89831f5316 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:02.470309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-757a2474-8513-4074-aa47-cb89831f5316 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085268 Jul 27 20:34:02.470868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 720/1475] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:02 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:03.491385 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a8398915-23bd-4bb0-8995-5f1569714015 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:03.492005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a8398915-23bd-4bb0-8995-5f1569714015 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:03.499063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8398915-23bd-4bb0-8995-5f1569714015 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:03.499545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8398915-23bd-4bb0-8995-5f1569714015 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:03.500303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8398915-23bd-4bb0-8995-5f1569714015 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:03.500767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8398915-23bd-4bb0-8995-5f1569714015 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:03.564826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a8398915-23bd-4bb0-8995-5f1569714015 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:03.572672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a8398915-23bd-4bb0-8995-5f1569714015 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085357 Jul 27 20:34:03.573243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 756/1476] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:04.594023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0405ddb6-9e7c-43e4-a2d2-b2a53725a1d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:04.594556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0405ddb6-9e7c-43e4-a2d2-b2a53725a1d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:04.601090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0405ddb6-9e7c-43e4-a2d2-b2a53725a1d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:04.601538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0405ddb6-9e7c-43e4-a2d2-b2a53725a1d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:04.602290 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0405ddb6-9e7c-43e4-a2d2-b2a53725a1d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:04.602720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0405ddb6-9e7c-43e4-a2d2-b2a53725a1d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:04.662008 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0405ddb6-9e7c-43e4-a2d2-b2a53725a1d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:04.669313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0405ddb6-9e7c-43e4-a2d2-b2a53725a1d5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079221 Jul 27 20:34:04.669868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 721/1477] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:05.689637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d0864f4d-abc6-4f6f-833e-4bbd506de084 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:05.690222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d0864f4d-abc6-4f6f-833e-4bbd506de084 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:05.695017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:05.699715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0864f4d-abc6-4f6f-833e-4bbd506de084 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:05.700163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0864f4d-abc6-4f6f-833e-4bbd506de084 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:05.700939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0864f4d-abc6-4f6f-833e-4bbd506de084 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:05.701363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0864f4d-abc6-4f6f-833e-4bbd506de084 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:05.760860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d0864f4d-abc6-4f6f-833e-4bbd506de084 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:05.768233 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d0864f4d-abc6-4f6f-833e-4bbd506de084 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082460 Jul 27 20:34:05.768823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 757/1478] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:06.789506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-05bdfea8-430d-4f0f-806e-e95b1dfe7a35 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:06.790126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-05bdfea8-430d-4f0f-806e-e95b1dfe7a35 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:06.792404 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=28 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:06.797183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05bdfea8-430d-4f0f-806e-e95b1dfe7a35 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:06.797632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05bdfea8-430d-4f0f-806e-e95b1dfe7a35 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:06.798387 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05bdfea8-430d-4f0f-806e-e95b1dfe7a35 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:06.798822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05bdfea8-430d-4f0f-806e-e95b1dfe7a35 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:06.857708 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-05bdfea8-430d-4f0f-806e-e95b1dfe7a35 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:06.865437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-05bdfea8-430d-4f0f-806e-e95b1dfe7a35 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079815 Jul 27 20:34:06.865993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 722/1479] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:07.885874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aef03c48-6029-422d-b5d8-9a148d0a7d66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:07.886489 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aef03c48-6029-422d-b5d8-9a148d0a7d66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:07.892979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aef03c48-6029-422d-b5d8-9a148d0a7d66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:07.893434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aef03c48-6029-422d-b5d8-9a148d0a7d66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:07.894196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aef03c48-6029-422d-b5d8-9a148d0a7d66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:07.895254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aef03c48-6029-422d-b5d8-9a148d0a7d66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:07.956850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aef03c48-6029-422d-b5d8-9a148d0a7d66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:07.965237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aef03c48-6029-422d-b5d8-9a148d0a7d66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083288 Jul 27 20:34:07.965817 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 758/1480] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:08.986017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-87766990-ab51-46a0-868e-1b220edd6c47 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:08.986723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-87766990-ab51-46a0-868e-1b220edd6c47 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:08.993294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87766990-ab51-46a0-868e-1b220edd6c47 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:08.993747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87766990-ab51-46a0-868e-1b220edd6c47 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:08.994506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87766990-ab51-46a0-868e-1b220edd6c47 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:08.994944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87766990-ab51-46a0-868e-1b220edd6c47 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:09.054929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-87766990-ab51-46a0-868e-1b220edd6c47 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:09.062371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-87766990-ab51-46a0-868e-1b220edd6c47 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080240 Jul 27 20:34:09.062932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 723/1481] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:08 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:10.083156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d00d484c-a462-4e83-aaec-4a89f417754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:10.083763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d00d484c-a462-4e83-aaec-4a89f417754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:10.090239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d00d484c-a462-4e83-aaec-4a89f417754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:10.090682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d00d484c-a462-4e83-aaec-4a89f417754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:10.091436 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d00d484c-a462-4e83-aaec-4a89f417754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:10.091864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d00d484c-a462-4e83-aaec-4a89f417754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:10.151286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d00d484c-a462-4e83-aaec-4a89f417754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:10.158575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d00d484c-a462-4e83-aaec-4a89f417754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079417 Jul 27 20:34:10.159140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 759/1482] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:11.180174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b6e2e99e-8ac2-4c8d-9148-c80f7046c4a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:11.180816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b6e2e99e-8ac2-4c8d-9148-c80f7046c4a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:11.187262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6e2e99e-8ac2-4c8d-9148-c80f7046c4a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:11.187713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6e2e99e-8ac2-4c8d-9148-c80f7046c4a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:11.188498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6e2e99e-8ac2-4c8d-9148-c80f7046c4a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:11.188940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6e2e99e-8ac2-4c8d-9148-c80f7046c4a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:11.193442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=84 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:11.250126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b6e2e99e-8ac2-4c8d-9148-c80f7046c4a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:11.258147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b6e2e99e-8ac2-4c8d-9148-c80f7046c4a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082371 Jul 27 20:34:11.258705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 724/1483] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:12.278559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf34000b-b7da-44f2-8cbc-15f95f631691 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:12.279169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf34000b-b7da-44f2-8cbc-15f95f631691 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:12.285688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf34000b-b7da-44f2-8cbc-15f95f631691 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:12.286137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf34000b-b7da-44f2-8cbc-15f95f631691 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:12.286897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf34000b-b7da-44f2-8cbc-15f95f631691 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:12.287329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf34000b-b7da-44f2-8cbc-15f95f631691 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:12.349616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf34000b-b7da-44f2-8cbc-15f95f631691 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:12.357205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf34000b-b7da-44f2-8cbc-15f95f631691 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082545 Jul 27 20:34:12.357769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 760/1484] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:13.378161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aa0560d0-2121-4e55-8cf3-af7944a4b43f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:13.378775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aa0560d0-2121-4e55-8cf3-af7944a4b43f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:13.385274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa0560d0-2121-4e55-8cf3-af7944a4b43f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:13.385733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa0560d0-2121-4e55-8cf3-af7944a4b43f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:13.386489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa0560d0-2121-4e55-8cf3-af7944a4b43f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:13.386923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa0560d0-2121-4e55-8cf3-af7944a4b43f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:13.446059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aa0560d0-2121-4e55-8cf3-af7944a4b43f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:13.453441 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aa0560d0-2121-4e55-8cf3-af7944a4b43f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079189 Jul 27 20:34:13.454009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 725/1485] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:14.474990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7d529867-363c-4d17-bb40-4e797f178b01 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:14.475658 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7d529867-363c-4d17-bb40-4e797f178b01 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:14.482174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d529867-363c-4d17-bb40-4e797f178b01 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:14.482624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d529867-363c-4d17-bb40-4e797f178b01 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:14.483383 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d529867-363c-4d17-bb40-4e797f178b01 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:14.483820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d529867-363c-4d17-bb40-4e797f178b01 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:14.543968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7d529867-363c-4d17-bb40-4e797f178b01 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:14.551985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7d529867-363c-4d17-bb40-4e797f178b01 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080770 Jul 27 20:34:14.552580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 761/1486] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:15.574371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-09cf62ce-2d26-45a6-ac56-8569edc93c86 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:15.574983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-09cf62ce-2d26-45a6-ac56-8569edc93c86 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:15.580982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09cf62ce-2d26-45a6-ac56-8569edc93c86 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:15.581429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09cf62ce-2d26-45a6-ac56-8569edc93c86 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:15.582184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09cf62ce-2d26-45a6-ac56-8569edc93c86 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:15.583717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09cf62ce-2d26-45a6-ac56-8569edc93c86 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:15.642607 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-09cf62ce-2d26-45a6-ac56-8569edc93c86 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:15.649867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-09cf62ce-2d26-45a6-ac56-8569edc93c86 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080454 Jul 27 20:34:15.650461 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 726/1487] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:15 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:16.670337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9be2806c-7242-40a1-a7ce-3223806e929b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:16.670957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9be2806c-7242-40a1-a7ce-3223806e929b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:16.677904 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9be2806c-7242-40a1-a7ce-3223806e929b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:16.678358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9be2806c-7242-40a1-a7ce-3223806e929b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:16.679115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9be2806c-7242-40a1-a7ce-3223806e929b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:16.679549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9be2806c-7242-40a1-a7ce-3223806e929b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:16.743584 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9be2806c-7242-40a1-a7ce-3223806e929b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:16.751428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9be2806c-7242-40a1-a7ce-3223806e929b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084944 Jul 27 20:34:16.751999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 762/1488] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:17.772571 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c9009a97-80d6-4461-8068-edf363627cf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:17.773172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c9009a97-80d6-4461-8068-edf363627cf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:17.779239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9009a97-80d6-4461-8068-edf363627cf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:17.779674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9009a97-80d6-4461-8068-edf363627cf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:17.780519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9009a97-80d6-4461-8068-edf363627cf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:17.780925 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9009a97-80d6-4461-8068-edf363627cf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:17.840674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c9009a97-80d6-4461-8068-edf363627cf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:17.848425 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c9009a97-80d6-4461-8068-edf363627cf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079981 Jul 27 20:34:17.848795 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 727/1489] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:18.869404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8af15602-172b-4aa6-9a4c-09ed5f7abf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:18.870018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8af15602-172b-4aa6-9a4c-09ed5f7abf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:18.876778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8af15602-172b-4aa6-9a4c-09ed5f7abf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:18.877229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8af15602-172b-4aa6-9a4c-09ed5f7abf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:18.877989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8af15602-172b-4aa6-9a4c-09ed5f7abf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:18.878422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8af15602-172b-4aa6-9a4c-09ed5f7abf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:18.940706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8af15602-172b-4aa6-9a4c-09ed5f7abf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:18.948855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8af15602-172b-4aa6-9a4c-09ed5f7abf4c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083346 Jul 27 20:34:18.949422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 763/1490] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:19.969284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9fc5ca9d-5d2b-4d0f-a60f-20d919791b69 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:19.969951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9fc5ca9d-5d2b-4d0f-a60f-20d919791b69 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:19.976847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fc5ca9d-5d2b-4d0f-a60f-20d919791b69 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:19.977294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fc5ca9d-5d2b-4d0f-a60f-20d919791b69 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:19.978047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fc5ca9d-5d2b-4d0f-a60f-20d919791b69 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:19.978479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fc5ca9d-5d2b-4d0f-a60f-20d919791b69 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:20.039662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9fc5ca9d-5d2b-4d0f-a60f-20d919791b69 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:20.046994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9fc5ca9d-5d2b-4d0f-a60f-20d919791b69 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081546 Jul 27 20:34:20.047550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 728/1491] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:21.069069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2d641563-4db0-41fb-82d3-a8f7fef409f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:21.069682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2d641563-4db0-41fb-82d3-a8f7fef409f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:21.076262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d641563-4db0-41fb-82d3-a8f7fef409f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:21.076763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d641563-4db0-41fb-82d3-a8f7fef409f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:21.077523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d641563-4db0-41fb-82d3-a8f7fef409f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:21.077959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d641563-4db0-41fb-82d3-a8f7fef409f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:21.081832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=84 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:21.140814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d641563-4db0-41fb-82d3-a8f7fef409f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:21.148843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2d641563-4db0-41fb-82d3-a8f7fef409f5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083592 Jul 27 20:34:21.149413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 764/1492] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:22.172492 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-69390bb3-a11a-451e-a21d-0156ce306c2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:22.173110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-69390bb3-a11a-451e-a21d-0156ce306c2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:22.179570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69390bb3-a11a-451e-a21d-0156ce306c2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:22.180023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69390bb3-a11a-451e-a21d-0156ce306c2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:22.180812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69390bb3-a11a-451e-a21d-0156ce306c2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:22.181252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69390bb3-a11a-451e-a21d-0156ce306c2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:22.240338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-69390bb3-a11a-451e-a21d-0156ce306c2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:22.248081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-69390bb3-a11a-451e-a21d-0156ce306c2c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079458 Jul 27 20:34:22.248678 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 729/1493] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:23.271056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c58fa7f4-216d-4ae9-a190-e30835aef3a9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:23.271664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c58fa7f4-216d-4ae9-a190-e30835aef3a9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:23.278302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c58fa7f4-216d-4ae9-a190-e30835aef3a9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:23.278784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c58fa7f4-216d-4ae9-a190-e30835aef3a9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:23.279585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c58fa7f4-216d-4ae9-a190-e30835aef3a9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:23.280008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c58fa7f4-216d-4ae9-a190-e30835aef3a9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:23.341249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c58fa7f4-216d-4ae9-a190-e30835aef3a9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:23.348550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c58fa7f4-216d-4ae9-a190-e30835aef3a9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081362 Jul 27 20:34:23.349116 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 765/1494] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:24.369168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ac2ae5f0-5987-468c-8ed0-64cbe64ca6e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:24.370860 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ac2ae5f0-5987-468c-8ed0-64cbe64ca6e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:24.376477 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac2ae5f0-5987-468c-8ed0-64cbe64ca6e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:24.376923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac2ae5f0-5987-468c-8ed0-64cbe64ca6e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:24.377669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac2ae5f0-5987-468c-8ed0-64cbe64ca6e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:24.378097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac2ae5f0-5987-468c-8ed0-64cbe64ca6e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:24.437863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ac2ae5f0-5987-468c-8ed0-64cbe64ca6e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:24.445735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ac2ae5f0-5987-468c-8ed0-64cbe64ca6e0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080439 Jul 27 20:34:24.446287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 730/1495] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:25.467305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-74967361-bc94-4204-bf37-99a30e6f14cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:25.467826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-74967361-bc94-4204-bf37-99a30e6f14cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:25.474077 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74967361-bc94-4204-bf37-99a30e6f14cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:25.474531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74967361-bc94-4204-bf37-99a30e6f14cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:25.475299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74967361-bc94-4204-bf37-99a30e6f14cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:25.475734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74967361-bc94-4204-bf37-99a30e6f14cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:25.537738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74967361-bc94-4204-bf37-99a30e6f14cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:25.545204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-74967361-bc94-4204-bf37-99a30e6f14cf tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082097 Jul 27 20:34:25.545765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 766/1496] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:26.566799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-705d09aa-00a3-4768-aacf-c27b15239157 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:26.567411 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-705d09aa-00a3-4768-aacf-c27b15239157 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:26.574036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-705d09aa-00a3-4768-aacf-c27b15239157 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:26.574428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-705d09aa-00a3-4768-aacf-c27b15239157 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:26.575222 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-705d09aa-00a3-4768-aacf-c27b15239157 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:26.575654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-705d09aa-00a3-4768-aacf-c27b15239157 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:26.636594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-705d09aa-00a3-4768-aacf-c27b15239157 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:26.643783 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-705d09aa-00a3-4768-aacf-c27b15239157 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081002 Jul 27 20:34:26.644350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 731/1497] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:27.665184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-39c7c176-2d45-4939-bdc7-663d8951f413 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:27.665715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39c7c176-2d45-4939-bdc7-663d8951f413 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:27.672220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7c176-2d45-4939-bdc7-663d8951f413 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:27.672708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7c176-2d45-4939-bdc7-663d8951f413 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:27.673474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7c176-2d45-4939-bdc7-663d8951f413 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:27.673907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7c176-2d45-4939-bdc7-663d8951f413 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:27.735038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-39c7c176-2d45-4939-bdc7-663d8951f413 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:27.742459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-39c7c176-2d45-4939-bdc7-663d8951f413 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081981 Jul 27 20:34:27.743036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 767/1498] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:27 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:28.762924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c7cb7896-222a-44a1-ab42-221957afc17b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:28.763542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c7cb7896-222a-44a1-ab42-221957afc17b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:28.770045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c7cb7896-222a-44a1-ab42-221957afc17b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:28.770500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c7cb7896-222a-44a1-ab42-221957afc17b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:28.771256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c7cb7896-222a-44a1-ab42-221957afc17b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:28.771692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c7cb7896-222a-44a1-ab42-221957afc17b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:28.831444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c7cb7896-222a-44a1-ab42-221957afc17b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:28.838897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c7cb7896-222a-44a1-ab42-221957afc17b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080213 Jul 27 20:34:28.839449 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 732/1499] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:29.859995 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f0b646f5-3791-4537-8a5b-26633cf76c5a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:29.860655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f0b646f5-3791-4537-8a5b-26633cf76c5a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:29.867860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0b646f5-3791-4537-8a5b-26633cf76c5a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:29.868307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0b646f5-3791-4537-8a5b-26633cf76c5a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:29.869102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0b646f5-3791-4537-8a5b-26633cf76c5a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:29.869533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0b646f5-3791-4537-8a5b-26633cf76c5a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:29.931734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f0b646f5-3791-4537-8a5b-26633cf76c5a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:29.939176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f0b646f5-3791-4537-8a5b-26633cf76c5a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083116 Jul 27 20:34:29.939738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 768/1500] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:30.959573 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4ff8af90-1e17-41c2-aa6e-3f17b6c1f173 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:30.960184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4ff8af90-1e17-41c2-aa6e-3f17b6c1f173 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:30.966679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff8af90-1e17-41c2-aa6e-3f17b6c1f173 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:30.967127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff8af90-1e17-41c2-aa6e-3f17b6c1f173 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:30.967886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff8af90-1e17-41c2-aa6e-3f17b6c1f173 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:30.968323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff8af90-1e17-41c2-aa6e-3f17b6c1f173 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:31.028532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4ff8af90-1e17-41c2-aa6e-3f17b6c1f173 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:31.036353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4ff8af90-1e17-41c2-aa6e-3f17b6c1f173 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080768 Jul 27 20:34:31.036945 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 733/1501] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:32.057590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5b7e30db-dca6-4b93-8e74-a8e6e797989e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:32.058200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5b7e30db-dca6-4b93-8e74-a8e6e797989e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:32.064762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b7e30db-dca6-4b93-8e74-a8e6e797989e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:32.065203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b7e30db-dca6-4b93-8e74-a8e6e797989e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:32.065949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b7e30db-dca6-4b93-8e74-a8e6e797989e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:32.066479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b7e30db-dca6-4b93-8e74-a8e6e797989e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:32.127715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5b7e30db-dca6-4b93-8e74-a8e6e797989e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:32.135254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5b7e30db-dca6-4b93-8e74-a8e6e797989e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081516 Jul 27 20:34:32.135823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 769/1502] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:33.156242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8ade85d8-f40e-4010-bc48-9b2af232165d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:33.156887 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8ade85d8-f40e-4010-bc48-9b2af232165d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:33.163365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ade85d8-f40e-4010-bc48-9b2af232165d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:33.163821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ade85d8-f40e-4010-bc48-9b2af232165d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:33.164620 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ade85d8-f40e-4010-bc48-9b2af232165d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:33.165065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ade85d8-f40e-4010-bc48-9b2af232165d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:33.224571 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ade85d8-f40e-4010-bc48-9b2af232165d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:33.231991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8ade85d8-f40e-4010-bc48-9b2af232165d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079646 Jul 27 20:34:33.232590 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 734/1503] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:33 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:34.253729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf6115d4-eb40-464a-b62c-a0e8e09a14cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:34.254858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf6115d4-eb40-464a-b62c-a0e8e09a14cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:34.261302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf6115d4-eb40-464a-b62c-a0e8e09a14cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:34.261750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf6115d4-eb40-464a-b62c-a0e8e09a14cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:34.262508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf6115d4-eb40-464a-b62c-a0e8e09a14cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:34.262944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf6115d4-eb40-464a-b62c-a0e8e09a14cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:34.329977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf6115d4-eb40-464a-b62c-a0e8e09a14cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:34.335589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf6115d4-eb40-464a-b62c-a0e8e09a14cd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085702 Jul 27 20:34:34.336251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 770/1504] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:35.356408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cb74162f-ede0-4737-aafc-ca2f711ce91e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:35.357027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cb74162f-ede0-4737-aafc-ca2f711ce91e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:35.363436 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cb74162f-ede0-4737-aafc-ca2f711ce91e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:35.363880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cb74162f-ede0-4737-aafc-ca2f711ce91e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:35.364663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cb74162f-ede0-4737-aafc-ca2f711ce91e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:35.365097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cb74162f-ede0-4737-aafc-ca2f711ce91e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:35.425524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cb74162f-ede0-4737-aafc-ca2f711ce91e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:35.432919 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cb74162f-ede0-4737-aafc-ca2f711ce91e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080376 Jul 27 20:34:35.433486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 735/1505] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:35 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:36.453833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9f8b6a2b-8235-4436-861e-d7cacda739b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:36.454445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9f8b6a2b-8235-4436-861e-d7cacda739b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:36.456744 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:36.461382 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f8b6a2b-8235-4436-861e-d7cacda739b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:36.461827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f8b6a2b-8235-4436-861e-d7cacda739b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:36.462623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f8b6a2b-8235-4436-861e-d7cacda739b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:36.463046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f8b6a2b-8235-4436-861e-d7cacda739b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:36.527227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9f8b6a2b-8235-4436-861e-d7cacda739b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:36.534776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9f8b6a2b-8235-4436-861e-d7cacda739b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084769 Jul 27 20:34:36.535833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 771/1506] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:37.556980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4ff3979b-fe8c-4dac-8b8f-eaed43b04f2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:37.557600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4ff3979b-fe8c-4dac-8b8f-eaed43b04f2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:37.559980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=28 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:37.564724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff3979b-fe8c-4dac-8b8f-eaed43b04f2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:37.565178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff3979b-fe8c-4dac-8b8f-eaed43b04f2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:37.566039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff3979b-fe8c-4dac-8b8f-eaed43b04f2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:37.567147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff3979b-fe8c-4dac-8b8f-eaed43b04f2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:37.638294 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4ff3979b-fe8c-4dac-8b8f-eaed43b04f2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:37.645796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4ff3979b-fe8c-4dac-8b8f-eaed43b04f2f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.092780 Jul 27 20:34:37.646354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 736/1507] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:38.666509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d6ae157d-3e0c-4c99-9786-acba583ff9f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:38.667045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d6ae157d-3e0c-4c99-9786-acba583ff9f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:38.673485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6ae157d-3e0c-4c99-9786-acba583ff9f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:38.673926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6ae157d-3e0c-4c99-9786-acba583ff9f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:38.674664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6ae157d-3e0c-4c99-9786-acba583ff9f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:38.675086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6ae157d-3e0c-4c99-9786-acba583ff9f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:38.734395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d6ae157d-3e0c-4c99-9786-acba583ff9f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:38.741730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d6ae157d-3e0c-4c99-9786-acba583ff9f8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079197 Jul 27 20:34:38.742285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 772/1508] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:39.763023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ec3f5be0-3b05-4fce-a822-8fd7d106427d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:39.763656 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ec3f5be0-3b05-4fce-a822-8fd7d106427d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:39.770647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec3f5be0-3b05-4fce-a822-8fd7d106427d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:39.771086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec3f5be0-3b05-4fce-a822-8fd7d106427d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:39.771834 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec3f5be0-3b05-4fce-a822-8fd7d106427d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:39.772262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec3f5be0-3b05-4fce-a822-8fd7d106427d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:39.837791 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ec3f5be0-3b05-4fce-a822-8fd7d106427d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:39.845403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ec3f5be0-3b05-4fce-a822-8fd7d106427d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.086237 Jul 27 20:34:39.845978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 737/1509] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:40.866552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1bb85b36-e64c-4b60-81fc-c1b04c8f240d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:40.867165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1bb85b36-e64c-4b60-81fc-c1b04c8f240d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:40.873857 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1bb85b36-e64c-4b60-81fc-c1b04c8f240d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:40.874310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1bb85b36-e64c-4b60-81fc-c1b04c8f240d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:40.875062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1bb85b36-e64c-4b60-81fc-c1b04c8f240d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:40.875499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1bb85b36-e64c-4b60-81fc-c1b04c8f240d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:40.935042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1bb85b36-e64c-4b60-81fc-c1b04c8f240d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:40.942869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1bb85b36-e64c-4b60-81fc-c1b04c8f240d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080197 Jul 27 20:34:40.943438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 773/1510] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:40 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:41.963830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c6186cd7-3308-42f5-aee9-200847b38720 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:41.964469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c6186cd7-3308-42f5-aee9-200847b38720 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:41.970999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6186cd7-3308-42f5-aee9-200847b38720 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:41.971449 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6186cd7-3308-42f5-aee9-200847b38720 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:41.972206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6186cd7-3308-42f5-aee9-200847b38720 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:41.973263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6186cd7-3308-42f5-aee9-200847b38720 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:41.975790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=84 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:42.035767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c6186cd7-3308-42f5-aee9-200847b38720 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:42.048206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c6186cd7-3308-42f5-aee9-200847b38720 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.088175 Jul 27 20:34:42.048877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 738/1511] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:41 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:43.069509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ac9a1eed-5eaa-4cbb-8433-f36c5b41d068 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:43.070053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ac9a1eed-5eaa-4cbb-8433-f36c5b41d068 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:43.076522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac9a1eed-5eaa-4cbb-8433-f36c5b41d068 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:43.077009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac9a1eed-5eaa-4cbb-8433-f36c5b41d068 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:43.077765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac9a1eed-5eaa-4cbb-8433-f36c5b41d068 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:43.078228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac9a1eed-5eaa-4cbb-8433-f36c5b41d068 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:43.138375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ac9a1eed-5eaa-4cbb-8433-f36c5b41d068 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:43.146422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ac9a1eed-5eaa-4cbb-8433-f36c5b41d068 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081494 Jul 27 20:34:43.147002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 774/1512] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:43 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:44.167258 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-38f9c79c-cfe8-4026-82c7-df4e33509577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:44.167807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-38f9c79c-cfe8-4026-82c7-df4e33509577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:44.174426 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38f9c79c-cfe8-4026-82c7-df4e33509577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:44.174892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38f9c79c-cfe8-4026-82c7-df4e33509577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:44.175650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38f9c79c-cfe8-4026-82c7-df4e33509577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:44.176081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-38f9c79c-cfe8-4026-82c7-df4e33509577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:44.241347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-38f9c79c-cfe8-4026-82c7-df4e33509577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:44.249013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-38f9c79c-cfe8-4026-82c7-df4e33509577 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085747 Jul 27 20:34:44.249580 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 739/1513] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:45.270285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-94d6eba1-73c7-4727-9ff4-5ee80144e9c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:45.270921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-94d6eba1-73c7-4727-9ff4-5ee80144e9c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:45.277376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-94d6eba1-73c7-4727-9ff4-5ee80144e9c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:45.277820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-94d6eba1-73c7-4727-9ff4-5ee80144e9c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:45.278576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-94d6eba1-73c7-4727-9ff4-5ee80144e9c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:45.279005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-94d6eba1-73c7-4727-9ff4-5ee80144e9c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:45.339531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-94d6eba1-73c7-4727-9ff4-5ee80144e9c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:45.347095 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-94d6eba1-73c7-4727-9ff4-5ee80144e9c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081329 Jul 27 20:34:45.348022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 775/1514] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:46.368814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5cadf41e-e924-4fa4-be5c-e41468d830be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:46.369463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5cadf41e-e924-4fa4-be5c-e41468d830be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:46.376425 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5cadf41e-e924-4fa4-be5c-e41468d830be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:46.376874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5cadf41e-e924-4fa4-be5c-e41468d830be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:46.377660 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5cadf41e-e924-4fa4-be5c-e41468d830be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:46.378092 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5cadf41e-e924-4fa4-be5c-e41468d830be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:46.443807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5cadf41e-e924-4fa4-be5c-e41468d830be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:46.452048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5cadf41e-e924-4fa4-be5c-e41468d830be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.087333 Jul 27 20:34:46.452886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 740/1515] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:46 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:47.475275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a75df371-0b07-4f3c-a76a-b09f666959a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:47.475881 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a75df371-0b07-4f3c-a76a-b09f666959a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:47.482470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a75df371-0b07-4f3c-a76a-b09f666959a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:47.491373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a75df371-0b07-4f3c-a76a-b09f666959a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:47.491373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a75df371-0b07-4f3c-a76a-b09f666959a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:47.491373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a75df371-0b07-4f3c-a76a-b09f666959a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:47.548349 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a75df371-0b07-4f3c-a76a-b09f666959a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:47.556361 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a75df371-0b07-4f3c-a76a-b09f666959a8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085402 Jul 27 20:34:47.557371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 776/1516] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:47 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:48.579658 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4ff959e8-e5a1-4acd-b270-9b9eb4a14eb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:48.580265 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4ff959e8-e5a1-4acd-b270-9b9eb4a14eb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:48.586822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff959e8-e5a1-4acd-b270-9b9eb4a14eb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:48.587206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff959e8-e5a1-4acd-b270-9b9eb4a14eb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:48.587959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff959e8-e5a1-4acd-b270-9b9eb4a14eb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:48.588402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ff959e8-e5a1-4acd-b270-9b9eb4a14eb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:48.648301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4ff959e8-e5a1-4acd-b270-9b9eb4a14eb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:48.655596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4ff959e8-e5a1-4acd-b270-9b9eb4a14eb9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079921 Jul 27 20:34:48.656169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 741/1517] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:48 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:49.676176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-654c1e4d-7892-454f-9d4e-ba56292d570d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:49.676743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-654c1e4d-7892-454f-9d4e-ba56292d570d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:49.683175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-654c1e4d-7892-454f-9d4e-ba56292d570d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:49.683617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-654c1e4d-7892-454f-9d4e-ba56292d570d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:49.684364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-654c1e4d-7892-454f-9d4e-ba56292d570d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:49.684831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-654c1e4d-7892-454f-9d4e-ba56292d570d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:49.744521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-654c1e4d-7892-454f-9d4e-ba56292d570d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:49.752152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-654c1e4d-7892-454f-9d4e-ba56292d570d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079941 Jul 27 20:34:49.752753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 777/1518] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:50.773782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ea1f6707-9eeb-4410-a690-ecd31000defb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:50.774429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ea1f6707-9eeb-4410-a690-ecd31000defb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:50.780896 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea1f6707-9eeb-4410-a690-ecd31000defb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:50.781367 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea1f6707-9eeb-4410-a690-ecd31000defb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:50.782110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea1f6707-9eeb-4410-a690-ecd31000defb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:50.782549 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea1f6707-9eeb-4410-a690-ecd31000defb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:50.844368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ea1f6707-9eeb-4410-a690-ecd31000defb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:50.851989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ea1f6707-9eeb-4410-a690-ecd31000defb tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082672 Jul 27 20:34:50.852602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 742/1519] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:51.873221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-842b3695-4c9f-42d2-be9a-dd3e44ac6677 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:51.873832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-842b3695-4c9f-42d2-be9a-dd3e44ac6677 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:51.880354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-842b3695-4c9f-42d2-be9a-dd3e44ac6677 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:51.880834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-842b3695-4c9f-42d2-be9a-dd3e44ac6677 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:51.881595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-842b3695-4c9f-42d2-be9a-dd3e44ac6677 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:51.882029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-842b3695-4c9f-42d2-be9a-dd3e44ac6677 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:51.884575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=84 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:51.945988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-842b3695-4c9f-42d2-be9a-dd3e44ac6677 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:51.954096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-842b3695-4c9f-42d2-be9a-dd3e44ac6677 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084988 Jul 27 20:34:51.954676 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 778/1520] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:52.975177 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-da5bf98c-4eb1-424d-8642-34f972966cde tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:52.975791 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-da5bf98c-4eb1-424d-8642-34f972966cde tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:52.982288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da5bf98c-4eb1-424d-8642-34f972966cde tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:52.982739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da5bf98c-4eb1-424d-8642-34f972966cde tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:52.983505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da5bf98c-4eb1-424d-8642-34f972966cde tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:52.983938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da5bf98c-4eb1-424d-8642-34f972966cde tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:53.045351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-da5bf98c-4eb1-424d-8642-34f972966cde tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:53.052835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-da5bf98c-4eb1-424d-8642-34f972966cde tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081617 Jul 27 20:34:53.054254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 743/1521] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:54.073549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8e1c59f5-5b63-4aeb-b482-4a2ae3c24790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:54.074169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8e1c59f5-5b63-4aeb-b482-4a2ae3c24790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:54.081001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e1c59f5-5b63-4aeb-b482-4a2ae3c24790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:54.081498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e1c59f5-5b63-4aeb-b482-4a2ae3c24790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:54.082262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e1c59f5-5b63-4aeb-b482-4a2ae3c24790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:54.082691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e1c59f5-5b63-4aeb-b482-4a2ae3c24790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:54.144262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e1c59f5-5b63-4aeb-b482-4a2ae3c24790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:54.151844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8e1c59f5-5b63-4aeb-b482-4a2ae3c24790 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082211 Jul 27 20:34:54.152436 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 779/1522] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:54 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:55.173428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-885723bd-e37e-4729-9292-12589bab56c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:55.174030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-885723bd-e37e-4729-9292-12589bab56c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:55.180611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-885723bd-e37e-4729-9292-12589bab56c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:55.181059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-885723bd-e37e-4729-9292-12589bab56c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:55.181811 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-885723bd-e37e-4729-9292-12589bab56c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:55.182240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-885723bd-e37e-4729-9292-12589bab56c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:55.246671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-885723bd-e37e-4729-9292-12589bab56c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:55.254689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-885723bd-e37e-4729-9292-12589bab56c9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085124 Jul 27 20:34:55.255254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 744/1523] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:56.275716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cd3ee7a6-a959-4a8d-95d3-47ebbe40dc78 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:56.276331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cd3ee7a6-a959-4a8d-95d3-47ebbe40dc78 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:56.282705 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd3ee7a6-a959-4a8d-95d3-47ebbe40dc78 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:56.283175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd3ee7a6-a959-4a8d-95d3-47ebbe40dc78 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:56.283962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd3ee7a6-a959-4a8d-95d3-47ebbe40dc78 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:56.284406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd3ee7a6-a959-4a8d-95d3-47ebbe40dc78 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:56.578443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cd3ee7a6-a959-4a8d-95d3-47ebbe40dc78 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:56.586632 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cd3ee7a6-a959-4a8d-95d3-47ebbe40dc78 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.314783 Jul 27 20:34:56.587207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 780/1524] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:57.607166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-13cf8f34-7aca-436a-9131-17f44d862857 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:57.607717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-13cf8f34-7aca-436a-9131-17f44d862857 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:57.614642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13cf8f34-7aca-436a-9131-17f44d862857 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:57.615088 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13cf8f34-7aca-436a-9131-17f44d862857 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:57.615839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13cf8f34-7aca-436a-9131-17f44d862857 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:57.616272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13cf8f34-7aca-436a-9131-17f44d862857 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:57.674647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-13cf8f34-7aca-436a-9131-17f44d862857 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:57.682782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-13cf8f34-7aca-436a-9131-17f44d862857 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079534 Jul 27 20:34:57.683348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 745/1525] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:57 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:58.704319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-525d7912-9fd1-4d94-bf44-d0d57880a6fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:58.704890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-525d7912-9fd1-4d94-bf44-d0d57880a6fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:58.711733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-525d7912-9fd1-4d94-bf44-d0d57880a6fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:58.712173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-525d7912-9fd1-4d94-bf44-d0d57880a6fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:58.712951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-525d7912-9fd1-4d94-bf44-d0d57880a6fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:58.713376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-525d7912-9fd1-4d94-bf44-d0d57880a6fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:58.773174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-525d7912-9fd1-4d94-bf44-d0d57880a6fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:58.780437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-525d7912-9fd1-4d94-bf44-d0d57880a6fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080049 Jul 27 20:34:58.781001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 781/1526] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:59.800756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f507c2e0-5b8f-435f-a8f4-b02110f9c733 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:59.801395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f507c2e0-5b8f-435f-a8f4-b02110f9c733 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:59.807985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f507c2e0-5b8f-435f-a8f4-b02110f9c733 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:59.808469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f507c2e0-5b8f-435f-a8f4-b02110f9c733 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:59.809231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f507c2e0-5b8f-435f-a8f4-b02110f9c733 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:59.809669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f507c2e0-5b8f-435f-a8f4-b02110f9c733 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:59.869576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f507c2e0-5b8f-435f-a8f4-b02110f9c733 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:59.877212 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f507c2e0-5b8f-435f-a8f4-b02110f9c733 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080397 Jul 27 20:34:59.877780 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 746/1527] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:59 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:00.898123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2e7c425c-d840-4ef8-b407-c82e557f8699 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:00.898763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2e7c425c-d840-4ef8-b407-c82e557f8699 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:00.905266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e7c425c-d840-4ef8-b407-c82e557f8699 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:00.905708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e7c425c-d840-4ef8-b407-c82e557f8699 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:00.906451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e7c425c-d840-4ef8-b407-c82e557f8699 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:00.906876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e7c425c-d840-4ef8-b407-c82e557f8699 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:00.968113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2e7c425c-d840-4ef8-b407-c82e557f8699 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:00.976249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2e7c425c-d840-4ef8-b407-c82e557f8699 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082500 Jul 27 20:35:00.976844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 782/1528] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:01.997341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f1834d46-30e3-4510-8689-ac2ca3b33aa6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:01.997953 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f1834d46-30e3-4510-8689-ac2ca3b33aa6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:02.004979 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1834d46-30e3-4510-8689-ac2ca3b33aa6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:02.005429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1834d46-30e3-4510-8689-ac2ca3b33aa6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:02.006185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1834d46-30e3-4510-8689-ac2ca3b33aa6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:02.006622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1834d46-30e3-4510-8689-ac2ca3b33aa6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:02.070343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f1834d46-30e3-4510-8689-ac2ca3b33aa6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:02.077916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f1834d46-30e3-4510-8689-ac2ca3b33aa6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084715 Jul 27 20:35:02.078478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 747/1529] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:01 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:03.099249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-49e61187-c7c0-4610-8e31-d25242a7ed23 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:03.099851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49e61187-c7c0-4610-8e31-d25242a7ed23 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:03.106440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49e61187-c7c0-4610-8e31-d25242a7ed23 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:03.106889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49e61187-c7c0-4610-8e31-d25242a7ed23 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:03.107636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49e61187-c7c0-4610-8e31-d25242a7ed23 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:03.108058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49e61187-c7c0-4610-8e31-d25242a7ed23 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:03.171038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49e61187-c7c0-4610-8e31-d25242a7ed23 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:03.179070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-49e61187-c7c0-4610-8e31-d25242a7ed23 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083756 Jul 27 20:35:03.179636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 783/1530] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:04.200604 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c2add3a1-14d3-41f3-a64a-dba3584b1f2a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:04.201219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c2add3a1-14d3-41f3-a64a-dba3584b1f2a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:04.208224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2add3a1-14d3-41f3-a64a-dba3584b1f2a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:04.208705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2add3a1-14d3-41f3-a64a-dba3584b1f2a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:04.209466 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2add3a1-14d3-41f3-a64a-dba3584b1f2a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:04.209903 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2add3a1-14d3-41f3-a64a-dba3584b1f2a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:04.270363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c2add3a1-14d3-41f3-a64a-dba3584b1f2a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:04.277838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c2add3a1-14d3-41f3-a64a-dba3584b1f2a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081215 Jul 27 20:35:04.278330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 748/1531] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:05.298853 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5b8b5604-1fac-4bf1-b736-80d60990253c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:05.299449 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5b8b5604-1fac-4bf1-b736-80d60990253c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:05.305972 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b8b5604-1fac-4bf1-b736-80d60990253c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:05.306419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b8b5604-1fac-4bf1-b736-80d60990253c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:05.307161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b8b5604-1fac-4bf1-b736-80d60990253c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:05.307585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b8b5604-1fac-4bf1-b736-80d60990253c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:05.370319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5b8b5604-1fac-4bf1-b736-80d60990253c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:05.378192 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5b8b5604-1fac-4bf1-b736-80d60990253c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083324 Jul 27 20:35:05.378755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 784/1532] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:06.398143 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a56ae1f2-7aff-4ee6-adc3-00d411fa253e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:06.398787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a56ae1f2-7aff-4ee6-adc3-00d411fa253e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:06.405517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a56ae1f2-7aff-4ee6-adc3-00d411fa253e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:06.405974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a56ae1f2-7aff-4ee6-adc3-00d411fa253e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:06.406768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a56ae1f2-7aff-4ee6-adc3-00d411fa253e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:06.407237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a56ae1f2-7aff-4ee6-adc3-00d411fa253e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:06.467832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a56ae1f2-7aff-4ee6-adc3-00d411fa253e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:06.475975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a56ae1f2-7aff-4ee6-adc3-00d411fa253e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081684 Jul 27 20:35:06.476575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 749/1533] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:07.497343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4a800ec4-b7f8-45ae-a8dd-5a0daf6f76c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:07.498103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4a800ec4-b7f8-45ae-a8dd-5a0daf6f76c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:07.500434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:07.505819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a800ec4-b7f8-45ae-a8dd-5a0daf6f76c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:07.506273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a800ec4-b7f8-45ae-a8dd-5a0daf6f76c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:07.507033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a800ec4-b7f8-45ae-a8dd-5a0daf6f76c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:07.507468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a800ec4-b7f8-45ae-a8dd-5a0daf6f76c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:07.568775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4a800ec4-b7f8-45ae-a8dd-5a0daf6f76c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:07.576232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4a800ec4-b7f8-45ae-a8dd-5a0daf6f76c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083005 Jul 27 20:35:07.576828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 785/1534] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:08.598036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-17135fbe-866e-46c8-ae61-1ca4a8ead67a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:08.598591 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-17135fbe-866e-46c8-ae61-1ca4a8ead67a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:08.600886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=28 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:08.605716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-17135fbe-866e-46c8-ae61-1ca4a8ead67a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:08.610846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-17135fbe-866e-46c8-ae61-1ca4a8ead67a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:08.610846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-17135fbe-866e-46c8-ae61-1ca4a8ead67a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:08.610846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-17135fbe-866e-46c8-ae61-1ca4a8ead67a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:08.668594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-17135fbe-866e-46c8-ae61-1ca4a8ead67a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:08.676799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-17135fbe-866e-46c8-ae61-1ca4a8ead67a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083252 Jul 27 20:35:08.677377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 750/1535] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:08 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:09.697520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3c9c963b-556d-4c98-85f3-741d4d9f0de7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:09.698050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3c9c963b-556d-4c98-85f3-741d4d9f0de7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:09.704461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c9c963b-556d-4c98-85f3-741d4d9f0de7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:09.704906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c9c963b-556d-4c98-85f3-741d4d9f0de7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:09.705654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c9c963b-556d-4c98-85f3-741d4d9f0de7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:09.706581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c9c963b-556d-4c98-85f3-741d4d9f0de7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:09.769217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3c9c963b-556d-4c98-85f3-741d4d9f0de7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:09.776646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3c9c963b-556d-4c98-85f3-741d4d9f0de7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083079 Jul 27 20:35:09.777215 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 786/1536] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:09 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:10.798110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-29bc41fe-5e11-4daf-82bd-7a0cfc59a429 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:10.798718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-29bc41fe-5e11-4daf-82bd-7a0cfc59a429 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:10.805858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29bc41fe-5e11-4daf-82bd-7a0cfc59a429 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:10.806306 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29bc41fe-5e11-4daf-82bd-7a0cfc59a429 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:10.807048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29bc41fe-5e11-4daf-82bd-7a0cfc59a429 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:10.807478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29bc41fe-5e11-4daf-82bd-7a0cfc59a429 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:10.869063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-29bc41fe-5e11-4daf-82bd-7a0cfc59a429 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:10.876953 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-29bc41fe-5e11-4daf-82bd-7a0cfc59a429 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082680 Jul 27 20:35:10.877513 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 751/1537] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:11.897513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ad9390b6-306c-4b24-8fca-1352c6954cc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:11.898129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ad9390b6-306c-4b24-8fca-1352c6954cc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:11.904715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ad9390b6-306c-4b24-8fca-1352c6954cc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:11.905166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ad9390b6-306c-4b24-8fca-1352c6954cc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:11.905926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ad9390b6-306c-4b24-8fca-1352c6954cc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:11.906359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ad9390b6-306c-4b24-8fca-1352c6954cc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:11.965767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ad9390b6-306c-4b24-8fca-1352c6954cc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:11.973168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ad9390b6-306c-4b24-8fca-1352c6954cc9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079550 Jul 27 20:35:11.973739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 787/1538] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:12.996013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b0331ab1-91d6-4913-b77b-c435ac1e511e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:12.996653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b0331ab1-91d6-4913-b77b-c435ac1e511e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:13.003616 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0331ab1-91d6-4913-b77b-c435ac1e511e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:13.004060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0331ab1-91d6-4913-b77b-c435ac1e511e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:13.004865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0331ab1-91d6-4913-b77b-c435ac1e511e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:13.005300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0331ab1-91d6-4913-b77b-c435ac1e511e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:13.007831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=84 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:13.066486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b0331ab1-91d6-4913-b77b-c435ac1e511e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:13.074198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b0331ab1-91d6-4913-b77b-c435ac1e511e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083193 Jul 27 20:35:13.074973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 752/1539] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:13.553753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:35:13.554242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:35:14.095077 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-015c1233-aa0d-4549-9f52-6705321de24d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:14.095680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-015c1233-aa0d-4549-9f52-6705321de24d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:14.102678 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-015c1233-aa0d-4549-9f52-6705321de24d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:14.103121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-015c1233-aa0d-4549-9f52-6705321de24d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:14.103874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-015c1233-aa0d-4549-9f52-6705321de24d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:14.104314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-015c1233-aa0d-4549-9f52-6705321de24d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:14.169025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-015c1233-aa0d-4549-9f52-6705321de24d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:14.176527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-015c1233-aa0d-4549-9f52-6705321de24d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085309 Jul 27 20:35:14.177051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 788/1540] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:15.197529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aba97e64-0676-4f59-a2b0-4b6f50562138 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:15.212542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aba97e64-0676-4f59-a2b0-4b6f50562138 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:15.212542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aba97e64-0676-4f59-a2b0-4b6f50562138 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:15.212542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aba97e64-0676-4f59-a2b0-4b6f50562138 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:15.212542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aba97e64-0676-4f59-a2b0-4b6f50562138 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:15.212935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aba97e64-0676-4f59-a2b0-4b6f50562138 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:15.265911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aba97e64-0676-4f59-a2b0-4b6f50562138 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:15.273440 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aba97e64-0676-4f59-a2b0-4b6f50562138 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079927 Jul 27 20:35:15.274004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 753/1541] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:15 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:16.294732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ab68560-c836-4b03-b3f7-2ac91d432e99 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:16.295344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ab68560-c836-4b03-b3f7-2ac91d432e99 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:16.302135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ab68560-c836-4b03-b3f7-2ac91d432e99 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:16.302587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ab68560-c836-4b03-b3f7-2ac91d432e99 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:16.303344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ab68560-c836-4b03-b3f7-2ac91d432e99 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:16.303774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ab68560-c836-4b03-b3f7-2ac91d432e99 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:16.364713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ab68560-c836-4b03-b3f7-2ac91d432e99 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:16.372507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ab68560-c836-4b03-b3f7-2ac91d432e99 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081624 Jul 27 20:35:16.373073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 789/1542] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:17.394410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-12c52cb8-a2f4-42b9-8b08-bed762f2df7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:17.395011 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-12c52cb8-a2f4-42b9-8b08-bed762f2df7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:17.401486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-12c52cb8-a2f4-42b9-8b08-bed762f2df7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:17.403669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-12c52cb8-a2f4-42b9-8b08-bed762f2df7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:17.403669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-12c52cb8-a2f4-42b9-8b08-bed762f2df7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:17.403669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-12c52cb8-a2f4-42b9-8b08-bed762f2df7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:17.464123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-12c52cb8-a2f4-42b9-8b08-bed762f2df7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:17.472260 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-12c52cb8-a2f4-42b9-8b08-bed762f2df7f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081692 Jul 27 20:35:17.472861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 754/1543] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:18.493046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b8ed9e56-e2ee-4284-a8ee-43bd9026e653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:18.493688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b8ed9e56-e2ee-4284-a8ee-43bd9026e653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:18.500447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8ed9e56-e2ee-4284-a8ee-43bd9026e653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:18.500900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8ed9e56-e2ee-4284-a8ee-43bd9026e653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:18.501657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8ed9e56-e2ee-4284-a8ee-43bd9026e653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:18.502094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8ed9e56-e2ee-4284-a8ee-43bd9026e653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:18.566866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b8ed9e56-e2ee-4284-a8ee-43bd9026e653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:18.574331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b8ed9e56-e2ee-4284-a8ee-43bd9026e653 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085145 Jul 27 20:35:18.574899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 790/1544] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:19.596826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7ea32a02-86bd-4a81-bf0e-1f6c35a5ab7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:19.597562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7ea32a02-86bd-4a81-bf0e-1f6c35a5ab7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:19.604055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ea32a02-86bd-4a81-bf0e-1f6c35a5ab7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:19.604584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ea32a02-86bd-4a81-bf0e-1f6c35a5ab7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:19.605345 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ea32a02-86bd-4a81-bf0e-1f6c35a5ab7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:19.605782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ea32a02-86bd-4a81-bf0e-1f6c35a5ab7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:19.666002 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7ea32a02-86bd-4a81-bf0e-1f6c35a5ab7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:19.673505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7ea32a02-86bd-4a81-bf0e-1f6c35a5ab7e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080709 Jul 27 20:35:19.674079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 755/1545] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:19 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:20.695174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c21b9bec-dfc2-4c03-9c4c-437f2c14d59c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:20.695711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c21b9bec-dfc2-4c03-9c4c-437f2c14d59c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:20.702186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c21b9bec-dfc2-4c03-9c4c-437f2c14d59c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:20.702632 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c21b9bec-dfc2-4c03-9c4c-437f2c14d59c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:20.703388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c21b9bec-dfc2-4c03-9c4c-437f2c14d59c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:20.703823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c21b9bec-dfc2-4c03-9c4c-437f2c14d59c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:20.763801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c21b9bec-dfc2-4c03-9c4c-437f2c14d59c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:20.771820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c21b9bec-dfc2-4c03-9c4c-437f2c14d59c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080649 Jul 27 20:35:20.772405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 791/1546] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:21.792992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8315502e-c526-409a-9d85-fb4fb4c3cff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:21.793610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8315502e-c526-409a-9d85-fb4fb4c3cff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:21.800401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8315502e-c526-409a-9d85-fb4fb4c3cff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:21.800876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8315502e-c526-409a-9d85-fb4fb4c3cff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:21.801636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8315502e-c526-409a-9d85-fb4fb4c3cff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:21.802077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8315502e-c526-409a-9d85-fb4fb4c3cff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:21.861499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8315502e-c526-409a-9d85-fb4fb4c3cff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:21.869292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8315502e-c526-409a-9d85-fb4fb4c3cff6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080220 Jul 27 20:35:21.869873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 756/1547] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:22.889952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a93ea7da-0cc7-47c9-bd82-55f176c40155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:22.890565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a93ea7da-0cc7-47c9-bd82-55f176c40155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:22.897026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a93ea7da-0cc7-47c9-bd82-55f176c40155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:22.897480 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a93ea7da-0cc7-47c9-bd82-55f176c40155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:22.898236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a93ea7da-0cc7-47c9-bd82-55f176c40155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:22.898671 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a93ea7da-0cc7-47c9-bd82-55f176c40155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:22.902550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=84 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:22.961407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a93ea7da-0cc7-47c9-bd82-55f176c40155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:22.969023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a93ea7da-0cc7-47c9-bd82-55f176c40155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082979 Jul 27 20:35:22.969596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 792/1548] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:23.990675 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3b2a91c0-5683-4499-ad8d-42afe374269c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:23.991288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3b2a91c0-5683-4499-ad8d-42afe374269c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:23.998260 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3b2a91c0-5683-4499-ad8d-42afe374269c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:23.998709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3b2a91c0-5683-4499-ad8d-42afe374269c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:23.999462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3b2a91c0-5683-4499-ad8d-42afe374269c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:23.999895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3b2a91c0-5683-4499-ad8d-42afe374269c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:24.059552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3b2a91c0-5683-4499-ad8d-42afe374269c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:24.067531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3b2a91c0-5683-4499-ad8d-42afe374269c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081222 Jul 27 20:35:24.068096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 757/1549] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:25.088661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cff4d428-5627-47ab-89f8-46c27c4b2829 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:25.089273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cff4d428-5627-47ab-89f8-46c27c4b2829 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:25.095608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cff4d428-5627-47ab-89f8-46c27c4b2829 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:25.096061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cff4d428-5627-47ab-89f8-46c27c4b2829 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:25.097344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cff4d428-5627-47ab-89f8-46c27c4b2829 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:25.097780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cff4d428-5627-47ab-89f8-46c27c4b2829 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:25.156797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cff4d428-5627-47ab-89f8-46c27c4b2829 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:25.164706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cff4d428-5627-47ab-89f8-46c27c4b2829 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080167 Jul 27 20:35:25.165276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 793/1550] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:26.185857 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f848ac51-9d6b-47c9-a58a-12486a1edd9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:26.186474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f848ac51-9d6b-47c9-a58a-12486a1edd9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:26.193079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f848ac51-9d6b-47c9-a58a-12486a1edd9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:26.193530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f848ac51-9d6b-47c9-a58a-12486a1edd9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:26.194284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f848ac51-9d6b-47c9-a58a-12486a1edd9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:26.194722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f848ac51-9d6b-47c9-a58a-12486a1edd9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:26.261938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f848ac51-9d6b-47c9-a58a-12486a1edd9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:26.269973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f848ac51-9d6b-47c9-a58a-12486a1edd9b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.088008 Jul 27 20:35:26.270534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 758/1551] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:27.291226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-93b912e6-3a79-4930-927e-ef811e96a155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:27.291836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-93b912e6-3a79-4930-927e-ef811e96a155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:27.298502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93b912e6-3a79-4930-927e-ef811e96a155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:27.298953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93b912e6-3a79-4930-927e-ef811e96a155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:27.299713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93b912e6-3a79-4930-927e-ef811e96a155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:27.300796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93b912e6-3a79-4930-927e-ef811e96a155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:27.364208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-93b912e6-3a79-4930-927e-ef811e96a155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:27.371694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-93b912e6-3a79-4930-927e-ef811e96a155 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084336 Jul 27 20:35:27.372257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 794/1552] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:27 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:28.392203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-098dad56-6c3a-432a-a361-474dd5b15320 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:28.392832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-098dad56-6c3a-432a-a361-474dd5b15320 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:28.399320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-098dad56-6c3a-432a-a361-474dd5b15320 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:28.399762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-098dad56-6c3a-432a-a361-474dd5b15320 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:28.400529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-098dad56-6c3a-432a-a361-474dd5b15320 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:28.400959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-098dad56-6c3a-432a-a361-474dd5b15320 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:28.460512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-098dad56-6c3a-432a-a361-474dd5b15320 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:28.467756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-098dad56-6c3a-432a-a361-474dd5b15320 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079413 Jul 27 20:35:28.468311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 759/1553] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:29.488463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-17b51670-dce1-40e9-9c29-24c627e971c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:29.489074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-17b51670-dce1-40e9-9c29-24c627e971c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:29.495401 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17b51670-dce1-40e9-9c29-24c627e971c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:29.496101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17b51670-dce1-40e9-9c29-24c627e971c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:29.496871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17b51670-dce1-40e9-9c29-24c627e971c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:29.497303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17b51670-dce1-40e9-9c29-24c627e971c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:29.557564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-17b51670-dce1-40e9-9c29-24c627e971c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:29.565154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-17b51670-dce1-40e9-9c29-24c627e971c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080584 Jul 27 20:35:29.566218 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 795/1554] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:30.586744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a43a8369-f488-424f-95af-735cbb20b8df tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:30.587355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a43a8369-f488-424f-95af-735cbb20b8df tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:30.593890 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a43a8369-f488-424f-95af-735cbb20b8df tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:30.594285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a43a8369-f488-424f-95af-735cbb20b8df tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:30.595048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a43a8369-f488-424f-95af-735cbb20b8df tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:30.595486 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a43a8369-f488-424f-95af-735cbb20b8df tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:30.656626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a43a8369-f488-424f-95af-735cbb20b8df tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:30.664796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a43a8369-f488-424f-95af-735cbb20b8df tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081880 Jul 27 20:35:30.665370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 760/1555] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:30 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:31.685306 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ab8da834-b108-46cd-a1b5-0bc50bbd6893 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:31.685960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ab8da834-b108-46cd-a1b5-0bc50bbd6893 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:31.692488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab8da834-b108-46cd-a1b5-0bc50bbd6893 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:31.692942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab8da834-b108-46cd-a1b5-0bc50bbd6893 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:31.693699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab8da834-b108-46cd-a1b5-0bc50bbd6893 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:31.694135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab8da834-b108-46cd-a1b5-0bc50bbd6893 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:31.757222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ab8da834-b108-46cd-a1b5-0bc50bbd6893 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:31.764821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ab8da834-b108-46cd-a1b5-0bc50bbd6893 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083327 Jul 27 20:35:31.765431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 796/1556] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:32.786933 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f0cfe72d-7762-4f22-aba4-b9b25a9e1090 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:32.787532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f0cfe72d-7762-4f22-aba4-b9b25a9e1090 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:32.794075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0cfe72d-7762-4f22-aba4-b9b25a9e1090 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:32.794525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0cfe72d-7762-4f22-aba4-b9b25a9e1090 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:32.795265 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0cfe72d-7762-4f22-aba4-b9b25a9e1090 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:32.795690 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0cfe72d-7762-4f22-aba4-b9b25a9e1090 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:32.855507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f0cfe72d-7762-4f22-aba4-b9b25a9e1090 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:32.863168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f0cfe72d-7762-4f22-aba4-b9b25a9e1090 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080605 Jul 27 20:35:32.863730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 761/1557] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:33.883054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a40171db-6cfa-42d5-bbc3-921195450a75 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:33.883668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a40171db-6cfa-42d5-bbc3-921195450a75 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:33.890207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a40171db-6cfa-42d5-bbc3-921195450a75 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:33.890657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a40171db-6cfa-42d5-bbc3-921195450a75 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:33.891421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a40171db-6cfa-42d5-bbc3-921195450a75 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:33.891903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a40171db-6cfa-42d5-bbc3-921195450a75 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:33.953136 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a40171db-6cfa-42d5-bbc3-921195450a75 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:33.961586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a40171db-6cfa-42d5-bbc3-921195450a75 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082392 Jul 27 20:35:33.962157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 797/1558] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:33 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:34.982805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bf0ff954-7cc3-4967-a223-14c6f53d86ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:34.983418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bf0ff954-7cc3-4967-a223-14c6f53d86ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:34.990551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf0ff954-7cc3-4967-a223-14c6f53d86ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:34.991000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf0ff954-7cc3-4967-a223-14c6f53d86ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:34.991751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf0ff954-7cc3-4967-a223-14c6f53d86ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:34.992183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf0ff954-7cc3-4967-a223-14c6f53d86ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:35.052355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bf0ff954-7cc3-4967-a223-14c6f53d86ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:35.059865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bf0ff954-7cc3-4967-a223-14c6f53d86ef tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080941 Jul 27 20:35:35.060443 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 762/1559] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:36.080444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4fa9d319-e08a-4458-8b4b-8f5e26b67fcd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:36.082980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4fa9d319-e08a-4458-8b4b-8f5e26b67fcd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:36.087626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4fa9d319-e08a-4458-8b4b-8f5e26b67fcd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:36.088071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4fa9d319-e08a-4458-8b4b-8f5e26b67fcd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:36.088847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4fa9d319-e08a-4458-8b4b-8f5e26b67fcd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:36.089271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4fa9d319-e08a-4458-8b4b-8f5e26b67fcd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:36.151202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4fa9d319-e08a-4458-8b4b-8f5e26b67fcd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:36.158532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4fa9d319-e08a-4458-8b4b-8f5e26b67fcd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081971 Jul 27 20:35:36.159122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 798/1560] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:37.178973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b4857bc0-190a-4dd3-8b46-6321520afd9e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:37.179575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b4857bc0-190a-4dd3-8b46-6321520afd9e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:37.185970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b4857bc0-190a-4dd3-8b46-6321520afd9e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:37.186415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b4857bc0-190a-4dd3-8b46-6321520afd9e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:37.187160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b4857bc0-190a-4dd3-8b46-6321520afd9e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:37.187584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b4857bc0-190a-4dd3-8b46-6321520afd9e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:37.246697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b4857bc0-190a-4dd3-8b46-6321520afd9e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:37.254412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b4857bc0-190a-4dd3-8b46-6321520afd9e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079334 Jul 27 20:35:37.254972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 763/1561] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:38.275245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-227033ce-949b-42dc-b3df-ba1a8f468917 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:38.275862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-227033ce-949b-42dc-b3df-ba1a8f468917 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:38.278224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:38.282924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-227033ce-949b-42dc-b3df-ba1a8f468917 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:38.283374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-227033ce-949b-42dc-b3df-ba1a8f468917 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:38.284813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-227033ce-949b-42dc-b3df-ba1a8f468917 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:38.285249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-227033ce-949b-42dc-b3df-ba1a8f468917 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:38.347631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-227033ce-949b-42dc-b3df-ba1a8f468917 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:38.355159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-227033ce-949b-42dc-b3df-ba1a8f468917 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083823 Jul 27 20:35:38.355725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 799/1562] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:39.375408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-70e1b856-73ee-415b-a93e-c6403dbb8cfe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:39.376015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-70e1b856-73ee-415b-a93e-c6403dbb8cfe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:39.378967 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=28 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:39.383771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70e1b856-73ee-415b-a93e-c6403dbb8cfe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:39.384221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70e1b856-73ee-415b-a93e-c6403dbb8cfe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:39.385011 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70e1b856-73ee-415b-a93e-c6403dbb8cfe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:39.385444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70e1b856-73ee-415b-a93e-c6403dbb8cfe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:39.465918 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-70e1b856-73ee-415b-a93e-c6403dbb8cfe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:39.473347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-70e1b856-73ee-415b-a93e-c6403dbb8cfe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.101804 Jul 27 20:35:39.473917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 764/1563] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:40.493584 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7f7e2050-d7b9-4328-ba17-00996351567e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:40.494207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7f7e2050-d7b9-4328-ba17-00996351567e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:40.500898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f7e2050-d7b9-4328-ba17-00996351567e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:40.501363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f7e2050-d7b9-4328-ba17-00996351567e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:40.502096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f7e2050-d7b9-4328-ba17-00996351567e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:40.502527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f7e2050-d7b9-4328-ba17-00996351567e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:40.562103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7f7e2050-d7b9-4328-ba17-00996351567e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:40.569413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7f7e2050-d7b9-4328-ba17-00996351567e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079777 Jul 27 20:35:40.569979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 800/1564] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:40 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:41.590790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-09162dc8-8f56-414d-a2da-3f026b6c28a5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:41.591334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-09162dc8-8f56-414d-a2da-3f026b6c28a5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:41.597786 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09162dc8-8f56-414d-a2da-3f026b6c28a5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:41.598236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09162dc8-8f56-414d-a2da-3f026b6c28a5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:41.598990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09162dc8-8f56-414d-a2da-3f026b6c28a5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:41.599425 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09162dc8-8f56-414d-a2da-3f026b6c28a5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:41.662725 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-09162dc8-8f56-414d-a2da-3f026b6c28a5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:41.670190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-09162dc8-8f56-414d-a2da-3f026b6c28a5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083416 Jul 27 20:35:41.670751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 765/1565] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:41 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:42.691007 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-404b0aa3-42f2-4e1c-92c1-5d915f198b66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:42.691537 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-404b0aa3-42f2-4e1c-92c1-5d915f198b66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:42.698100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-404b0aa3-42f2-4e1c-92c1-5d915f198b66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:42.698554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-404b0aa3-42f2-4e1c-92c1-5d915f198b66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:42.699315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-404b0aa3-42f2-4e1c-92c1-5d915f198b66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:42.699751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-404b0aa3-42f2-4e1c-92c1-5d915f198b66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:42.760798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-404b0aa3-42f2-4e1c-92c1-5d915f198b66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:42.768732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-404b0aa3-42f2-4e1c-92c1-5d915f198b66 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081182 Jul 27 20:35:42.769304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 801/1566] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:42 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:43.789719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b6252b79-92aa-4280-9890-d86e7036cc28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:43.790321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b6252b79-92aa-4280-9890-d86e7036cc28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:43.797049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6252b79-92aa-4280-9890-d86e7036cc28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:43.797487 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6252b79-92aa-4280-9890-d86e7036cc28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:43.798229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6252b79-92aa-4280-9890-d86e7036cc28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:43.798655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b6252b79-92aa-4280-9890-d86e7036cc28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:43.801160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=84 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:43.859502 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b6252b79-92aa-4280-9890-d86e7036cc28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:43.867347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b6252b79-92aa-4280-9890-d86e7036cc28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081491 Jul 27 20:35:43.867906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 766/1567] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:43 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:44.888814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-08cb96fd-a694-4f17-af3e-5ec4b95df6ed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:44.889417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-08cb96fd-a694-4f17-af3e-5ec4b95df6ed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:44.896355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08cb96fd-a694-4f17-af3e-5ec4b95df6ed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:44.896846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08cb96fd-a694-4f17-af3e-5ec4b95df6ed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:44.897633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08cb96fd-a694-4f17-af3e-5ec4b95df6ed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:44.898058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08cb96fd-a694-4f17-af3e-5ec4b95df6ed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:44.957243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-08cb96fd-a694-4f17-af3e-5ec4b95df6ed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:44.964688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-08cb96fd-a694-4f17-af3e-5ec4b95df6ed tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079707 Jul 27 20:35:44.965257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 802/1568] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:44 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:45.986136 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f55a11e-41f8-47f2-8d12-004e6a6b18c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:45.987410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6f55a11e-41f8-47f2-8d12-004e6a6b18c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:45.994143 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f55a11e-41f8-47f2-8d12-004e6a6b18c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:45.994587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f55a11e-41f8-47f2-8d12-004e6a6b18c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:45.995341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f55a11e-41f8-47f2-8d12-004e6a6b18c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:45.996028 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f55a11e-41f8-47f2-8d12-004e6a6b18c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:46.058655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6f55a11e-41f8-47f2-8d12-004e6a6b18c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:46.066370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6f55a11e-41f8-47f2-8d12-004e6a6b18c4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084213 Jul 27 20:35:46.066935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 767/1569] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:45 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:47.086984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9bb745f3-7a92-4096-ae9b-3482b23450e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:47.087591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9bb745f3-7a92-4096-ae9b-3482b23450e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:47.093943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bb745f3-7a92-4096-ae9b-3482b23450e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:47.094385 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bb745f3-7a92-4096-ae9b-3482b23450e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:47.095128 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bb745f3-7a92-4096-ae9b-3482b23450e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:47.095554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bb745f3-7a92-4096-ae9b-3482b23450e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:47.157162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9bb745f3-7a92-4096-ae9b-3482b23450e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:47.164440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9bb745f3-7a92-4096-ae9b-3482b23450e1 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081263 Jul 27 20:35:47.164997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 803/1570] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:47 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:48.185806 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a1c2894d-54c3-489f-848c-cdb3cd2426e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:48.186533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a1c2894d-54c3-489f-848c-cdb3cd2426e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:48.193089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1c2894d-54c3-489f-848c-cdb3cd2426e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:48.193542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1c2894d-54c3-489f-848c-cdb3cd2426e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:48.194304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1c2894d-54c3-489f-848c-cdb3cd2426e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:48.194741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1c2894d-54c3-489f-848c-cdb3cd2426e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:48.255772 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a1c2894d-54c3-489f-848c-cdb3cd2426e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:48.263320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a1c2894d-54c3-489f-848c-cdb3cd2426e6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081485 Jul 27 20:35:48.263891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 768/1571] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:48 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:48.307736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:35:48.308282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:35:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:35:49.285093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f3d242e2-048e-410a-830a-9034c002754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:49.285776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f3d242e2-048e-410a-830a-9034c002754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:49.292420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3d242e2-048e-410a-830a-9034c002754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:49.292874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3d242e2-048e-410a-830a-9034c002754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:49.293634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3d242e2-048e-410a-830a-9034c002754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:49.294069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3d242e2-048e-410a-830a-9034c002754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:49.356713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f3d242e2-048e-410a-830a-9034c002754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:49.364221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f3d242e2-048e-410a-830a-9034c002754b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083511 Jul 27 20:35:49.364815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 804/1572] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:49 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:50.384321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3451b433-e244-4452-8089-e9b99a39342a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:50.384995 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3451b433-e244-4452-8089-e9b99a39342a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:50.391454 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3451b433-e244-4452-8089-e9b99a39342a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:50.391904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3451b433-e244-4452-8089-e9b99a39342a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:50.392697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3451b433-e244-4452-8089-e9b99a39342a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:50.393134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3451b433-e244-4452-8089-e9b99a39342a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:50.457479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3451b433-e244-4452-8089-e9b99a39342a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:50.465203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3451b433-e244-4452-8089-e9b99a39342a tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084720 Jul 27 20:35:50.465777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 769/1573] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:50 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:51.485949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-54d9eda7-ccc9-4624-bf82-71d96bea88b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:51.486551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-54d9eda7-ccc9-4624-bf82-71d96bea88b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:51.493585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54d9eda7-ccc9-4624-bf82-71d96bea88b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:51.494035 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54d9eda7-ccc9-4624-bf82-71d96bea88b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:51.494781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54d9eda7-ccc9-4624-bf82-71d96bea88b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:51.495212 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54d9eda7-ccc9-4624-bf82-71d96bea88b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:51.554880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-54d9eda7-ccc9-4624-bf82-71d96bea88b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:51.562207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-54d9eda7-ccc9-4624-bf82-71d96bea88b9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080225 Jul 27 20:35:51.562761 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 805/1574] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:51 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:52.581863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-39c51320-0093-43d4-8ba1-937b1e42b6be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:52.582476 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-39c51320-0093-43d4-8ba1-937b1e42b6be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:52.589024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-39c51320-0093-43d4-8ba1-937b1e42b6be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:52.589473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-39c51320-0093-43d4-8ba1-937b1e42b6be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:52.590228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-39c51320-0093-43d4-8ba1-937b1e42b6be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:52.590712 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-39c51320-0093-43d4-8ba1-937b1e42b6be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:52.650380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-39c51320-0093-43d4-8ba1-937b1e42b6be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:52.657867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-39c51320-0093-43d4-8ba1-937b1e42b6be tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079902 Jul 27 20:35:52.658432 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 770/1575] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:52 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:53.678347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f6e13bd1-d142-464d-beff-abc1b3d6a8ff tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:53.678868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f6e13bd1-d142-464d-beff-abc1b3d6a8ff tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:53.685240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6e13bd1-d142-464d-beff-abc1b3d6a8ff tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:53.685682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6e13bd1-d142-464d-beff-abc1b3d6a8ff tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:53.686455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6e13bd1-d142-464d-beff-abc1b3d6a8ff tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:53.686877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6e13bd1-d142-464d-beff-abc1b3d6a8ff tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:53.746515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6e13bd1-d142-464d-beff-abc1b3d6a8ff tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:53.754344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f6e13bd1-d142-464d-beff-abc1b3d6a8ff tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079524 Jul 27 20:35:53.754896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 806/1576] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:53 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:54.775580 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3ed1b453-32ce-4293-80cf-1cb855f7c6b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:54.776194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3ed1b453-32ce-4293-80cf-1cb855f7c6b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:54.782821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ed1b453-32ce-4293-80cf-1cb855f7c6b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:54.783272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ed1b453-32ce-4293-80cf-1cb855f7c6b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:54.784027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ed1b453-32ce-4293-80cf-1cb855f7c6b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:54.784491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3ed1b453-32ce-4293-80cf-1cb855f7c6b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:54.849577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3ed1b453-32ce-4293-80cf-1cb855f7c6b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:54.857015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3ed1b453-32ce-4293-80cf-1cb855f7c6b8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.085361 Jul 27 20:35:54.857588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 771/1577] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:54 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:55.877742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-35ba838e-7f12-4bce-874a-0bb71335ec64 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:55.878351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-35ba838e-7f12-4bce-874a-0bb71335ec64 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:55.884549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35ba838e-7f12-4bce-874a-0bb71335ec64 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:55.884999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35ba838e-7f12-4bce-874a-0bb71335ec64 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:55.885749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35ba838e-7f12-4bce-874a-0bb71335ec64 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:55.886178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35ba838e-7f12-4bce-874a-0bb71335ec64 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:55.889997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=90 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:55.945468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-35ba838e-7f12-4bce-874a-0bb71335ec64 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:55.952765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-35ba838e-7f12-4bce-874a-0bb71335ec64 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.078902 Jul 27 20:35:55.953341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 807/1578] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:55 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:56.973937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-76badabf-d04b-40a7-83f0-a5f5a1a543e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:56.974575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-76badabf-d04b-40a7-83f0-a5f5a1a543e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:56.981033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76badabf-d04b-40a7-83f0-a5f5a1a543e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:56.981483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76badabf-d04b-40a7-83f0-a5f5a1a543e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:56.982231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76badabf-d04b-40a7-83f0-a5f5a1a543e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:56.982665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76badabf-d04b-40a7-83f0-a5f5a1a543e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:57.042888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-76badabf-d04b-40a7-83f0-a5f5a1a543e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:57.050275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-76badabf-d04b-40a7-83f0-a5f5a1a543e2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080865 Jul 27 20:35:57.050882 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 772/1579] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:56 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:58.071457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0a68c49d-d630-4fd5-b9de-ee99c715502d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:58.072073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0a68c49d-d630-4fd5-b9de-ee99c715502d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:58.078831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a68c49d-d630-4fd5-b9de-ee99c715502d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:58.079286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a68c49d-d630-4fd5-b9de-ee99c715502d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:58.080044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a68c49d-d630-4fd5-b9de-ee99c715502d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:58.080507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a68c49d-d630-4fd5-b9de-ee99c715502d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:58.141514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0a68c49d-d630-4fd5-b9de-ee99c715502d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:58.149585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0a68c49d-d630-4fd5-b9de-ee99c715502d tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082005 Jul 27 20:35:58.150081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 808/1580] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:58 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:59.169427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-78212efb-0bf9-4350-a09e-2c0cca9d575c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:59.170127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-78212efb-0bf9-4350-a09e-2c0cca9d575c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:59.176660 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78212efb-0bf9-4350-a09e-2c0cca9d575c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:59.177116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78212efb-0bf9-4350-a09e-2c0cca9d575c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:59.177886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78212efb-0bf9-4350-a09e-2c0cca9d575c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:59.178317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78212efb-0bf9-4350-a09e-2c0cca9d575c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:59.240852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-78212efb-0bf9-4350-a09e-2c0cca9d575c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:59.248523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-78212efb-0bf9-4350-a09e-2c0cca9d575c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083066 Jul 27 20:35:59.249088 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 773/1581] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:59 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:00.268356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6b55c956-6e3a-4328-900d-de874972ef63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:00.269034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6b55c956-6e3a-4328-900d-de874972ef63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:00.275504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b55c956-6e3a-4328-900d-de874972ef63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:00.275955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b55c956-6e3a-4328-900d-de874972ef63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:00.276738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b55c956-6e3a-4328-900d-de874972ef63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:00.277172 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b55c956-6e3a-4328-900d-de874972ef63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:00.339488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6b55c956-6e3a-4328-900d-de874972ef63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:00.347061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6b55c956-6e3a-4328-900d-de874972ef63 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082599 Jul 27 20:36:00.348123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 809/1582] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:00 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:01.369031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0c518b16-42b9-4108-9b89-e6be108afcf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:01.369678 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0c518b16-42b9-4108-9b89-e6be108afcf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:01.376418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c518b16-42b9-4108-9b89-e6be108afcf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:01.376868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c518b16-42b9-4108-9b89-e6be108afcf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:01.377623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c518b16-42b9-4108-9b89-e6be108afcf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:01.378057 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c518b16-42b9-4108-9b89-e6be108afcf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:01.438086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0c518b16-42b9-4108-9b89-e6be108afcf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:01.446296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0c518b16-42b9-4108-9b89-e6be108afcf0 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081113 Jul 27 20:36:01.446857 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 774/1583] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:01 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:02.469325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-350240d0-139a-4251-825b-bf5516f07aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:02.470009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-350240d0-139a-4251-825b-bf5516f07aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:02.476941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-350240d0-139a-4251-825b-bf5516f07aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:02.477387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-350240d0-139a-4251-825b-bf5516f07aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:02.478131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-350240d0-139a-4251-825b-bf5516f07aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:02.478563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-350240d0-139a-4251-825b-bf5516f07aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:02.538837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-350240d0-139a-4251-825b-bf5516f07aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:02.546175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-350240d0-139a-4251-825b-bf5516f07aa5 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080747 Jul 27 20:36:02.546735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 810/1584] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:02 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:03.567435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-415422e0-c59e-4e77-9880-7b4b884ad400 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:03.568046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-415422e0-c59e-4e77-9880-7b4b884ad400 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:03.574535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-415422e0-c59e-4e77-9880-7b4b884ad400 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:03.574983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-415422e0-c59e-4e77-9880-7b4b884ad400 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:03.575738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-415422e0-c59e-4e77-9880-7b4b884ad400 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:03.576173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-415422e0-c59e-4e77-9880-7b4b884ad400 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:03.638914 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-415422e0-c59e-4e77-9880-7b4b884ad400 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:03.646364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-415422e0-c59e-4e77-9880-7b4b884ad400 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083493 Jul 27 20:36:03.646938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 775/1585] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:03 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:04.667108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-79cd6a03-672b-4a5f-b674-d250a55f7826 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:04.667642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-79cd6a03-672b-4a5f-b674-d250a55f7826 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:04.674032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79cd6a03-672b-4a5f-b674-d250a55f7826 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:04.674471 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79cd6a03-672b-4a5f-b674-d250a55f7826 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:04.675225 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79cd6a03-672b-4a5f-b674-d250a55f7826 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:04.675664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79cd6a03-672b-4a5f-b674-d250a55f7826 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:04.735676 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-79cd6a03-672b-4a5f-b674-d250a55f7826 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:04.743061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-79cd6a03-672b-4a5f-b674-d250a55f7826 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080024 Jul 27 20:36:04.743624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 811/1586] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:04 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:05.765030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e4bb823c-72d6-4f61-8e2e-6797524f8f21 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:05.765633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e4bb823c-72d6-4f61-8e2e-6797524f8f21 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:05.772146 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4bb823c-72d6-4f61-8e2e-6797524f8f21 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:05.772621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4bb823c-72d6-4f61-8e2e-6797524f8f21 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:05.773368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4bb823c-72d6-4f61-8e2e-6797524f8f21 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:05.773793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4bb823c-72d6-4f61-8e2e-6797524f8f21 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:05.833962 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e4bb823c-72d6-4f61-8e2e-6797524f8f21 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:05.841261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e4bb823c-72d6-4f61-8e2e-6797524f8f21 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080057 Jul 27 20:36:05.841820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 776/1587] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:05 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:06.862331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e6160e51-e9e8-4492-9367-e71c78d70e2e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:06.863469 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e6160e51-e9e8-4492-9367-e71c78d70e2e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:06.869961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6160e51-e9e8-4492-9367-e71c78d70e2e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:06.870403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6160e51-e9e8-4492-9367-e71c78d70e2e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:06.871406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6160e51-e9e8-4492-9367-e71c78d70e2e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:06.871834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6160e51-e9e8-4492-9367-e71c78d70e2e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:06.932627 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e6160e51-e9e8-4492-9367-e71c78d70e2e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:06.940047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e6160e51-e9e8-4492-9367-e71c78d70e2e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081588 Jul 27 20:36:06.940641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 812/1588] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:06 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:07.960237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4704fd0e-ed01-4820-b156-3adbc265eb5b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:07.960856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4704fd0e-ed01-4820-b156-3adbc265eb5b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:07.967547 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4704fd0e-ed01-4820-b156-3adbc265eb5b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:07.968017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4704fd0e-ed01-4820-b156-3adbc265eb5b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:07.968782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4704fd0e-ed01-4820-b156-3adbc265eb5b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:07.969214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4704fd0e-ed01-4820-b156-3adbc265eb5b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:08.035289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4704fd0e-ed01-4820-b156-3adbc265eb5b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:08.042768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4704fd0e-ed01-4820-b156-3adbc265eb5b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.086437 Jul 27 20:36:08.043333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 777/1589] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:07 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:09.063655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0eae6966-039f-457c-89de-d2f6726bf5f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:09.064276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0eae6966-039f-457c-89de-d2f6726bf5f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:09.067189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:09.071925 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0eae6966-039f-457c-89de-d2f6726bf5f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:09.072374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0eae6966-039f-457c-89de-d2f6726bf5f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:09.073168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0eae6966-039f-457c-89de-d2f6726bf5f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:09.073605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0eae6966-039f-457c-89de-d2f6726bf5f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:09.133874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0eae6966-039f-457c-89de-d2f6726bf5f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:09.141459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0eae6966-039f-457c-89de-d2f6726bf5f6 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081664 Jul 27 20:36:09.142026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 813/1590] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:09 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:10.162706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4bc6d6ec-9aa7-4ef8-836e-0abc7da1e6a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:10.163334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4bc6d6ec-9aa7-4ef8-836e-0abc7da1e6a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:10.165646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=28 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:10.170504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bc6d6ec-9aa7-4ef8-836e-0abc7da1e6a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:10.170950 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bc6d6ec-9aa7-4ef8-836e-0abc7da1e6a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:10.171700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bc6d6ec-9aa7-4ef8-836e-0abc7da1e6a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:10.172132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bc6d6ec-9aa7-4ef8-836e-0abc7da1e6a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:10.232012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4bc6d6ec-9aa7-4ef8-836e-0abc7da1e6a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:10.239959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4bc6d6ec-9aa7-4ef8-836e-0abc7da1e6a2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081620 Jul 27 20:36:10.240545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 778/1591] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:10 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:11.260911 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-38da428e-7b55-485a-b597-c7ba93fa391e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:11.261522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-38da428e-7b55-485a-b597-c7ba93fa391e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:11.268597 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38da428e-7b55-485a-b597-c7ba93fa391e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:11.269548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38da428e-7b55-485a-b597-c7ba93fa391e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:11.270307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38da428e-7b55-485a-b597-c7ba93fa391e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:11.270745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38da428e-7b55-485a-b597-c7ba93fa391e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:11.330454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-38da428e-7b55-485a-b597-c7ba93fa391e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:11.338491 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-38da428e-7b55-485a-b597-c7ba93fa391e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081470 Jul 27 20:36:11.339064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 814/1592] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:11 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:12.359117 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-45c986ea-1539-4b5b-bf24-9a0a9a408c89 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:12.359764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-45c986ea-1539-4b5b-bf24-9a0a9a408c89 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:12.366969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-45c986ea-1539-4b5b-bf24-9a0a9a408c89 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:12.367418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-45c986ea-1539-4b5b-bf24-9a0a9a408c89 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:12.368202 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-45c986ea-1539-4b5b-bf24-9a0a9a408c89 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:12.368671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-45c986ea-1539-4b5b-bf24-9a0a9a408c89 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:12.432230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-45c986ea-1539-4b5b-bf24-9a0a9a408c89 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:12.439762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-45c986ea-1539-4b5b-bf24-9a0a9a408c89 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.084588 Jul 27 20:36:12.440330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 779/1593] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:12 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:13.460322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-67436e0f-6be5-4c32-9c49-23a184c34860 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:13.460964 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-67436e0f-6be5-4c32-9c49-23a184c34860 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:13.467441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-67436e0f-6be5-4c32-9c49-23a184c34860 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:13.467886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-67436e0f-6be5-4c32-9c49-23a184c34860 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:13.468668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-67436e0f-6be5-4c32-9c49-23a184c34860 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:13.469098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-67436e0f-6be5-4c32-9c49-23a184c34860 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:13.529229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-67436e0f-6be5-4c32-9c49-23a184c34860 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:13.537195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-67436e0f-6be5-4c32-9c49-23a184c34860 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081234 Jul 27 20:36:13.537758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 815/1594] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:13 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:14.557439 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5f469701-f950-45c7-bdde-6f0a3bee0da3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:14.558052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5f469701-f950-45c7-bdde-6f0a3bee0da3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:14.564142 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5f469701-f950-45c7-bdde-6f0a3bee0da3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:14.564638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5f469701-f950-45c7-bdde-6f0a3bee0da3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:14.565398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5f469701-f950-45c7-bdde-6f0a3bee0da3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:14.565832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5f469701-f950-45c7-bdde-6f0a3bee0da3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:14.568400 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=84 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:14.627083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5f469701-f950-45c7-bdde-6f0a3bee0da3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:14.634472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5f469701-f950-45c7-bdde-6f0a3bee0da3 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081138 Jul 27 20:36:14.635036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 780/1595] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:14 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:15.655026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-671b83df-b249-487e-a880-a0e047611af2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:15.655529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-671b83df-b249-487e-a880-a0e047611af2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:15.662547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671b83df-b249-487e-a880-a0e047611af2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:15.662984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671b83df-b249-487e-a880-a0e047611af2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:15.663727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671b83df-b249-487e-a880-a0e047611af2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:15.664153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671b83df-b249-487e-a880-a0e047611af2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:15.727208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-671b83df-b249-487e-a880-a0e047611af2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:15.734560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-671b83df-b249-487e-a880-a0e047611af2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083474 Jul 27 20:36:15.735120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 816/1596] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:15 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:16.755788 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6458c4ec-b7e1-429e-b58f-1ac452e6a7e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:16.756407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6458c4ec-b7e1-429e-b58f-1ac452e6a7e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:16.762951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6458c4ec-b7e1-429e-b58f-1ac452e6a7e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:16.763392 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6458c4ec-b7e1-429e-b58f-1ac452e6a7e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:16.764140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6458c4ec-b7e1-429e-b58f-1ac452e6a7e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:16.764600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6458c4ec-b7e1-429e-b58f-1ac452e6a7e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:16.827129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6458c4ec-b7e1-429e-b58f-1ac452e6a7e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:16.835200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6458c4ec-b7e1-429e-b58f-1ac452e6a7e4 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083763 Jul 27 20:36:16.835767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 781/1597] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:16 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:17.855538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-74b84b0c-3d90-4a02-9032-7809360606fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:17.856150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-74b84b0c-3d90-4a02-9032-7809360606fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:17.862849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74b84b0c-3d90-4a02-9032-7809360606fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:17.863300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74b84b0c-3d90-4a02-9032-7809360606fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:17.864062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74b84b0c-3d90-4a02-9032-7809360606fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:17.864527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74b84b0c-3d90-4a02-9032-7809360606fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:17.930265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74b84b0c-3d90-4a02-9032-7809360606fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:17.937824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-74b84b0c-3d90-4a02-9032-7809360606fd tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.086116 Jul 27 20:36:17.938387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 817/1598] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:17 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:18.958556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9293c403-8abf-4fef-a7b9-86b887712c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:18.959326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9293c403-8abf-4fef-a7b9-86b887712c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:18.965878 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9293c403-8abf-4fef-a7b9-86b887712c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:18.966330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9293c403-8abf-4fef-a7b9-86b887712c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:18.967089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9293c403-8abf-4fef-a7b9-86b887712c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:18.967525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9293c403-8abf-4fef-a7b9-86b887712c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:19.030159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9293c403-8abf-4fef-a7b9-86b887712c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:19.038290 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9293c403-8abf-4fef-a7b9-86b887712c6c tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083614 Jul 27 20:36:19.038859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 782/1599] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:18 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:20.059142 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9fefde0b-4301-4b40-8906-0de747fa206f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:20.059755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9fefde0b-4301-4b40-8906-0de747fa206f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:20.066346 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9fefde0b-4301-4b40-8906-0de747fa206f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:20.066741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9fefde0b-4301-4b40-8906-0de747fa206f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:20.067501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9fefde0b-4301-4b40-8906-0de747fa206f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:20.067936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9fefde0b-4301-4b40-8906-0de747fa206f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:20.128947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9fefde0b-4301-4b40-8906-0de747fa206f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:20.135916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9fefde0b-4301-4b40-8906-0de747fa206f tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080716 Jul 27 20:36:20.136540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 818/1600] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:20 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:21.157354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-380a2b65-e067-4fb0-8fd7-eab50a7a3927 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:21.157969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-380a2b65-e067-4fb0-8fd7-eab50a7a3927 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:21.165214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-380a2b65-e067-4fb0-8fd7-eab50a7a3927 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:21.165667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-380a2b65-e067-4fb0-8fd7-eab50a7a3927 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:21.166426 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-380a2b65-e067-4fb0-8fd7-eab50a7a3927 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:21.166865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-380a2b65-e067-4fb0-8fd7-eab50a7a3927 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:21.229295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-380a2b65-e067-4fb0-8fd7-eab50a7a3927 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:21.236631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-380a2b65-e067-4fb0-8fd7-eab50a7a3927 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083188 Jul 27 20:36:21.237205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 783/1601] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:21 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:22.257151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1927be81-bb4a-42a6-9996-f12f2dbeab0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:22.257768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1927be81-bb4a-42a6-9996-f12f2dbeab0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:22.264266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1927be81-bb4a-42a6-9996-f12f2dbeab0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:22.264749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1927be81-bb4a-42a6-9996-f12f2dbeab0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:22.265509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1927be81-bb4a-42a6-9996-f12f2dbeab0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:22.265942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1927be81-bb4a-42a6-9996-f12f2dbeab0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:22.325717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1927be81-bb4a-42a6-9996-f12f2dbeab0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:22.333823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1927be81-bb4a-42a6-9996-f12f2dbeab0e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080533 Jul 27 20:36:22.334393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 819/1602] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:22 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:23.355011 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f22f150e-bb60-4cee-b029-f9b8dae1042b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:23.355621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f22f150e-bb60-4cee-b029-f9b8dae1042b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:23.362062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f22f150e-bb60-4cee-b029-f9b8dae1042b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:23.362597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f22f150e-bb60-4cee-b029-f9b8dae1042b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:23.363431 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f22f150e-bb60-4cee-b029-f9b8dae1042b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:23.363885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f22f150e-bb60-4cee-b029-f9b8dae1042b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:23.426331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f22f150e-bb60-4cee-b029-f9b8dae1042b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:23.433792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f22f150e-bb60-4cee-b029-f9b8dae1042b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.082642 Jul 27 20:36:23.434361 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 784/1603] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:23 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:24.454838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4eadd4a4-d0d6-44cb-becd-39dedde724d9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:24.455446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4eadd4a4-d0d6-44cb-becd-39dedde724d9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:24.462505 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4eadd4a4-d0d6-44cb-becd-39dedde724d9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:24.462951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4eadd4a4-d0d6-44cb-becd-39dedde724d9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:24.463701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4eadd4a4-d0d6-44cb-becd-39dedde724d9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:24.464132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4eadd4a4-d0d6-44cb-becd-39dedde724d9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:24.524334 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4eadd4a4-d0d6-44cb-becd-39dedde724d9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:24.531776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4eadd4a4-d0d6-44cb-becd-39dedde724d9 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080891 Jul 27 20:36:24.532338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 820/1604] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:24 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:25.552588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a7c54fe4-7d2a-4491-bcd2-2a6ebc775d32 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:25.553207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a7c54fe4-7d2a-4491-bcd2-2a6ebc775d32 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:25.559716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7c54fe4-7d2a-4491-bcd2-2a6ebc775d32 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:25.560168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7c54fe4-7d2a-4491-bcd2-2a6ebc775d32 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:25.560958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7c54fe4-7d2a-4491-bcd2-2a6ebc775d32 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:25.561395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7c54fe4-7d2a-4491-bcd2-2a6ebc775d32 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:25.623114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a7c54fe4-7d2a-4491-bcd2-2a6ebc775d32 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:25.630605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a7c54fe4-7d2a-4491-bcd2-2a6ebc775d32 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081953 Jul 27 20:36:25.631175 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 785/1605] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:25 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:26.651937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ea094660-673f-46d2-bc64-3901440b857e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:26.652532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ea094660-673f-46d2-bc64-3901440b857e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:26.658562 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea094660-673f-46d2-bc64-3901440b857e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:26.659504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea094660-673f-46d2-bc64-3901440b857e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:26.660258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea094660-673f-46d2-bc64-3901440b857e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:26.660723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea094660-673f-46d2-bc64-3901440b857e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:26.663236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=84 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:26.720058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ea094660-673f-46d2-bc64-3901440b857e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:26.727867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ea094660-673f-46d2-bc64-3901440b857e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080075 Jul 27 20:36:26.728451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 821/1606] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:26 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:27.749620 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-531a77ea-fb7b-425e-8d32-8e449da792b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:27.750237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-531a77ea-fb7b-425e-8d32-8e449da792b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:27.756843 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-531a77ea-fb7b-425e-8d32-8e449da792b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:27.757302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-531a77ea-fb7b-425e-8d32-8e449da792b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:27.758055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-531a77ea-fb7b-425e-8d32-8e449da792b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:27.758492 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-531a77ea-fb7b-425e-8d32-8e449da792b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:27.817844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-531a77ea-fb7b-425e-8d32-8e449da792b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:27.825252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-531a77ea-fb7b-425e-8d32-8e449da792b7 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079747 Jul 27 20:36:27.825823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 786/1607] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:27 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:28.854643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-52982bd4-90e3-4e6e-bf1d-e10a161d7d42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:28.855246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-52982bd4-90e3-4e6e-bf1d-e10a161d7d42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:28.861704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52982bd4-90e3-4e6e-bf1d-e10a161d7d42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:28.862779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52982bd4-90e3-4e6e-bf1d-e10a161d7d42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:28.863523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52982bd4-90e3-4e6e-bf1d-e10a161d7d42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:28.863949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52982bd4-90e3-4e6e-bf1d-e10a161d7d42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:28.923384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-52982bd4-90e3-4e6e-bf1d-e10a161d7d42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:28.931374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-52982bd4-90e3-4e6e-bf1d-e10a161d7d42 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080600 Jul 27 20:36:28.931931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 822/1608] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:28 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:29.951962 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b0234133-f3f4-4510-a93f-aff1c54cc99b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:29.952665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b0234133-f3f4-4510-a93f-aff1c54cc99b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:29.959642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0234133-f3f4-4510-a93f-aff1c54cc99b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:29.960095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0234133-f3f4-4510-a93f-aff1c54cc99b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:29.960886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0234133-f3f4-4510-a93f-aff1c54cc99b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:29.961349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0234133-f3f4-4510-a93f-aff1c54cc99b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:30.023738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b0234133-f3f4-4510-a93f-aff1c54cc99b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:30.031250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b0234133-f3f4-4510-a93f-aff1c54cc99b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083166 Jul 27 20:36:30.031827 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 787/1609] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:29 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:31.053073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d627c1e-f312-4080-bbc5-94ce8139ef28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:31.053630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1d627c1e-f312-4080-bbc5-94ce8139ef28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:31.059943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d627c1e-f312-4080-bbc5-94ce8139ef28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:31.060403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d627c1e-f312-4080-bbc5-94ce8139ef28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:31.061152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d627c1e-f312-4080-bbc5-94ce8139ef28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:31.061580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d627c1e-f312-4080-bbc5-94ce8139ef28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:31.122942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1d627c1e-f312-4080-bbc5-94ce8139ef28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:31.130429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1d627c1e-f312-4080-bbc5-94ce8139ef28 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.081924 Jul 27 20:36:31.130996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 823/1610] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:31 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:32.151226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0eba45fb-50b7-459b-9aed-81ec97ac3e98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:32.151839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0eba45fb-50b7-459b-9aed-81ec97ac3e98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:32.158350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0eba45fb-50b7-459b-9aed-81ec97ac3e98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:32.158800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0eba45fb-50b7-459b-9aed-81ec97ac3e98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:32.159562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0eba45fb-50b7-459b-9aed-81ec97ac3e98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:32.160006 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0eba45fb-50b7-459b-9aed-81ec97ac3e98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:32.219665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0eba45fb-50b7-459b-9aed-81ec97ac3e98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:32.227075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0eba45fb-50b7-459b-9aed-81ec97ac3e98 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.079714 Jul 27 20:36:32.236033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 788/1611] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:32 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:33.247883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5b443c36-1f78-4255-a89b-46041c696a5e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:33.248598 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5b443c36-1f78-4255-a89b-46041c696a5e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:33.255603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b443c36-1f78-4255-a89b-46041c696a5e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:33.256056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b443c36-1f78-4255-a89b-46041c696a5e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:33.256849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b443c36-1f78-4255-a89b-46041c696a5e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:33.257288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b443c36-1f78-4255-a89b-46041c696a5e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:33.317124 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5b443c36-1f78-4255-a89b-46041c696a5e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:33.324559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5b443c36-1f78-4255-a89b-46041c696a5e tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080799 Jul 27 20:36:33.325132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 824/1612] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:33 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:34.346734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6acc175f-d507-464f-aece-eab09f146e92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:34.347358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6acc175f-d507-464f-aece-eab09f146e92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:34.353864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6acc175f-d507-464f-aece-eab09f146e92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:34.354312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6acc175f-d507-464f-aece-eab09f146e92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:34.355066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6acc175f-d507-464f-aece-eab09f146e92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:34.355501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6acc175f-d507-464f-aece-eab09f146e92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:34.417908 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6acc175f-d507-464f-aece-eab09f146e92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:34.425399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6acc175f-d507-464f-aece-eab09f146e92 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.083173 Jul 27 20:36:34.425959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 789/1613] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:34 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:35.446637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7933fdee-16af-407c-af63-30dacea4c2fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:35.447242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7933fdee-16af-407c-af63-30dacea4c2fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:35.453692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7933fdee-16af-407c-af63-30dacea4c2fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:35.454127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7933fdee-16af-407c-af63-30dacea4c2fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:35.454871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7933fdee-16af-407c-af63-30dacea4c2fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:35.455292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7933fdee-16af-407c-af63-30dacea4c2fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:35.514973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7933fdee-16af-407c-af63-30dacea4c2fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:35.523089 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7933fdee-16af-407c-af63-30dacea4c2fe tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080328 Jul 27 20:36:35.523665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 825/1614] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:35 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:36.543079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8bcc284b-30c4-48a7-b0c2-3d2b5c52f0f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:36.543693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8bcc284b-30c4-48a7-b0c2-3d2b5c52f0f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:36.550710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bcc284b-30c4-48a7-b0c2-3d2b5c52f0f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:36.551157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bcc284b-30c4-48a7-b0c2-3d2b5c52f0f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:36.551915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bcc284b-30c4-48a7-b0c2-3d2b5c52f0f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:36.552354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bcc284b-30c4-48a7-b0c2-3d2b5c52f0f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:36.611503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8bcc284b-30c4-48a7-b0c2-3d2b5c52f0f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:36.619406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8bcc284b-30c4-48a7-b0c2-3d2b5c52f0f2 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080257 Jul 27 20:36:36.619980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 790/1615] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:36 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:37.686211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f8e277f8-9818-4a90-9d84-7ae589ed1f0b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:37.686830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f8e277f8-9818-4a90-9d84-7ae589ed1f0b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:37.692803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8e277f8-9818-4a90-9d84-7ae589ed1f0b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:37.693254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8e277f8-9818-4a90-9d84-7ae589ed1f0b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:37.694015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8e277f8-9818-4a90-9d84-7ae589ed1f0b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:37.694450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8e277f8-9818-4a90-9d84-7ae589ed1f0b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:37.755090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f8e277f8-9818-4a90-9d84-7ae589ed1f0b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:37.762540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f8e277f8-9818-4a90-9d84-7ae589ed1f0b tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.125546 Jul 27 20:36:37.763109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 826/1616] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:37 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:38.783958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7a9b796a-02ed-423c-959e-6887c6e999c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:38.784595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7a9b796a-02ed-423c-959e-6887c6e999c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:38.791129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a9b796a-02ed-423c-959e-6887c6e999c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:38.791575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a9b796a-02ed-423c-959e-6887c6e999c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:38.792328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a9b796a-02ed-423c-959e-6887c6e999c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:38.792800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a9b796a-02ed-423c-959e-6887c6e999c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:38.858241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7a9b796a-02ed-423c-959e-6887c6e999c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:38.869976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7a9b796a-02ed-423c-959e-6887c6e999c8 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.090376 Jul 27 20:36:38.870546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 791/1617] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:38 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:39.889947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b8dab53e-9ce0-42c6-b5ec-09262fc438da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:39.890542 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b8dab53e-9ce0-42c6-b5ec-09262fc438da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] [instance: af31f4cf-e692-45de-8dd8-242a7c0279fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:39.897561 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8dab53e-9ce0-42c6-b5ec-09262fc438da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:39.898010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8dab53e-9ce0-42c6-b5ec-09262fc438da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:39.898768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8dab53e-9ce0-42c6-b5ec-09262fc438da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:39.899201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8dab53e-9ce0-42c6-b5ec-09262fc438da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:39.958861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b8dab53e-9ce0-42c6-b5ec-09262fc438da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726227067d2499e9934a824fc4c31a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c519d693b2424b9e0acc02143c6e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:39.966426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b8dab53e-9ce0-42c6-b5ec-09262fc438da tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa" status: 200 len: 1213 microversion: 2.1 time: 0.080350 Jul 27 20:36:39.966989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 827/1618] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:39 2022] GET /compute/v2.1/servers/af31f4cf-e692-45de-8dd8-242a7c0279fa => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:40.203427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-693386bb-d0a4-41be-a024-b74acca59d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] Calling method '.version_select at 0x7f35ca4c6310>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:40.213924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=28 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:40.310814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-693386bb-d0a4-41be-a024-b74acca59d44 tempest-TestShelveInstance-113040525 tempest-TestShelveInstance-113040525-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1931530333" status: 202 len: 0 microversion: 2.1 time: 0.111159 Jul 27 20:36:40.311407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 792/1619] 10.222.0.47 () {58 vars in 1254 bytes} [Wed Jul 27 20:36:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1931530333 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:36:40.420644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a4d9ad0e-532a-4912-8a02-9a824e53b658 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:40.421143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a4d9ad0e-532a-4912-8a02-9a824e53b658 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:40.427660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4d9ad0e-532a-4912-8a02-9a824e53b658 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.428302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4d9ad0e-532a-4912-8a02-9a824e53b658 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.429168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4d9ad0e-532a-4912-8a02-9a824e53b658 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.429507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4d9ad0e-532a-4912-8a02-9a824e53b658 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.464476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a4d9ad0e-532a-4912-8a02-9a824e53b658 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:36:40.738560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a4d9ad0e-532a-4912-8a02-9a824e53b658 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 204 len: 0 microversion: 2.1 time: 0.321446 Jul 27 20:36:40.739366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 828/1620] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:36:40 2022] DELETE /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:36:40.747975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-981a4863-efc2-40ab-bd21-96cdf367902a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:40.748668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-981a4863-efc2-40ab-bd21-96cdf367902a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:40.755521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-981a4863-efc2-40ab-bd21-96cdf367902a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.755975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-981a4863-efc2-40ab-bd21-96cdf367902a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.756777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-981a4863-efc2-40ab-bd21-96cdf367902a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.757214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-981a4863-efc2-40ab-bd21-96cdf367902a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.998990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-981a4863-efc2-40ab-bd21-96cdf367902a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:41.007788 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-981a4863-efc2-40ab-bd21-96cdf367902a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.264112 Jul 27 20:36:41.008591 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 793/1621] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:40 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:42.030492 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-63da38d7-bf6c-445a-a9fe-3f4a9fa5f2b2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:42.031244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-63da38d7-bf6c-445a-a9fe-3f4a9fa5f2b2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:42.033746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:42.039035 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63da38d7-bf6c-445a-a9fe-3f4a9fa5f2b2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:42.039488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63da38d7-bf6c-445a-a9fe-3f4a9fa5f2b2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:42.040312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63da38d7-bf6c-445a-a9fe-3f4a9fa5f2b2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:42.040761 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63da38d7-bf6c-445a-a9fe-3f4a9fa5f2b2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:42.391819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-63da38d7-bf6c-445a-a9fe-3f4a9fa5f2b2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:42.403462 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-63da38d7-bf6c-445a-a9fe-3f4a9fa5f2b2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.377199 Jul 27 20:36:42.404516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 829/1622] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:42 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:43.424194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-470148d4-ca6e-447b-bffa-9fed7efe5b33 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:43.424904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-470148d4-ca6e-447b-bffa-9fed7efe5b33 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:43.431360 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-470148d4-ca6e-447b-bffa-9fed7efe5b33 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:43.431818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-470148d4-ca6e-447b-bffa-9fed7efe5b33 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:43.432574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-470148d4-ca6e-447b-bffa-9fed7efe5b33 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:43.433003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-470148d4-ca6e-447b-bffa-9fed7efe5b33 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:43.567350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-470148d4-ca6e-447b-bffa-9fed7efe5b33 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:43.575327 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-470148d4-ca6e-447b-bffa-9fed7efe5b33 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.155102 Jul 27 20:36:43.575906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 794/1623] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:43 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:44.598082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-db098b2f-7f03-48f0-b74c-c57c93adb897 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:44.598993 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-db098b2f-7f03-48f0-b74c-c57c93adb897 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:44.607741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db098b2f-7f03-48f0-b74c-c57c93adb897 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:44.608303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db098b2f-7f03-48f0-b74c-c57c93adb897 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:44.609803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db098b2f-7f03-48f0-b74c-c57c93adb897 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:44.610500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db098b2f-7f03-48f0-b74c-c57c93adb897 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:44.763521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-db098b2f-7f03-48f0-b74c-c57c93adb897 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:44.770065 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-db098b2f-7f03-48f0-b74c-c57c93adb897 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.176871 Jul 27 20:36:44.770626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 830/1624] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:44 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:45.792018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5c089209-55a4-4091-b9cc-9071a3e15abb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:45.792805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5c089209-55a4-4091-b9cc-9071a3e15abb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:45.800402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c089209-55a4-4091-b9cc-9071a3e15abb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:45.800877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c089209-55a4-4091-b9cc-9071a3e15abb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:45.801659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c089209-55a4-4091-b9cc-9071a3e15abb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:45.802128 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c089209-55a4-4091-b9cc-9071a3e15abb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:45.807223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=84 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:46.280048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5c089209-55a4-4091-b9cc-9071a3e15abb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:46.288021 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5c089209-55a4-4091-b9cc-9071a3e15abb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.500110 Jul 27 20:36:46.288630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 795/1625] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:45 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:47.311741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a8ba8462-f1f3-484d-9fa7-ff62da9d066c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:47.312367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a8ba8462-f1f3-484d-9fa7-ff62da9d066c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:47.320001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8ba8462-f1f3-484d-9fa7-ff62da9d066c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:47.320767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8ba8462-f1f3-484d-9fa7-ff62da9d066c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:47.321883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8ba8462-f1f3-484d-9fa7-ff62da9d066c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:47.322471 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8ba8462-f1f3-484d-9fa7-ff62da9d066c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:47.460099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a8ba8462-f1f3-484d-9fa7-ff62da9d066c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:47.473396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a8ba8462-f1f3-484d-9fa7-ff62da9d066c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.166739 Jul 27 20:36:47.477419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 831/1626] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:47 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:48.494835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dcbdcf0c-03ef-4dcf-9896-1d7bcbce4711 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:48.496207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dcbdcf0c-03ef-4dcf-9896-1d7bcbce4711 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:48.502929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dcbdcf0c-03ef-4dcf-9896-1d7bcbce4711 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:48.503430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dcbdcf0c-03ef-4dcf-9896-1d7bcbce4711 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:48.504174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dcbdcf0c-03ef-4dcf-9896-1d7bcbce4711 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:48.504800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dcbdcf0c-03ef-4dcf-9896-1d7bcbce4711 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:48.636759 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dcbdcf0c-03ef-4dcf-9896-1d7bcbce4711 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:48.645336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dcbdcf0c-03ef-4dcf-9896-1d7bcbce4711 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154376 Jul 27 20:36:48.645916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 796/1627] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:48 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:49.255898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:36:49.256506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:36:49.667156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-44bf2e42-6ad4-4106-95ec-b6f34a138ac0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:49.667769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-44bf2e42-6ad4-4106-95ec-b6f34a138ac0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:49.674277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44bf2e42-6ad4-4106-95ec-b6f34a138ac0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:49.674730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44bf2e42-6ad4-4106-95ec-b6f34a138ac0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:49.675494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44bf2e42-6ad4-4106-95ec-b6f34a138ac0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:49.676514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44bf2e42-6ad4-4106-95ec-b6f34a138ac0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:49.806918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-44bf2e42-6ad4-4106-95ec-b6f34a138ac0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:49.814966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-44bf2e42-6ad4-4106-95ec-b6f34a138ac0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151777 Jul 27 20:36:49.815612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 832/1628] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:49 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:49.849961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:36:49.850518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:36:50.836701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-30bf07c6-6a7f-43e6-a265-0e538f332ec9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:50.837403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-30bf07c6-6a7f-43e6-a265-0e538f332ec9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:50.843966 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30bf07c6-6a7f-43e6-a265-0e538f332ec9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:50.844519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30bf07c6-6a7f-43e6-a265-0e538f332ec9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:50.845279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30bf07c6-6a7f-43e6-a265-0e538f332ec9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:50.845713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-30bf07c6-6a7f-43e6-a265-0e538f332ec9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:50.977781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-30bf07c6-6a7f-43e6-a265-0e538f332ec9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:50.985715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-30bf07c6-6a7f-43e6-a265-0e538f332ec9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152935 Jul 27 20:36:50.986371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 797/1629] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:50 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:52.007226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1f92c065-8a4f-4fb7-9df9-2c8f72d762fe tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:52.008106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1f92c065-8a4f-4fb7-9df9-2c8f72d762fe tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:52.015093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-8a4f-4fb7-9df9-2c8f72d762fe tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:52.015799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-8a4f-4fb7-9df9-2c8f72d762fe tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:52.016594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-8a4f-4fb7-9df9-2c8f72d762fe tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:52.017046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f92c065-8a4f-4fb7-9df9-2c8f72d762fe tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:52.146897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1f92c065-8a4f-4fb7-9df9-2c8f72d762fe tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:52.155212 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1f92c065-8a4f-4fb7-9df9-2c8f72d762fe tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151848 Jul 27 20:36:52.155788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 833/1630] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:52 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:53.177815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-734b8811-141c-44e9-93a5-dfd16a67b37c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:53.178320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-734b8811-141c-44e9-93a5-dfd16a67b37c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:53.184890 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-734b8811-141c-44e9-93a5-dfd16a67b37c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:53.185341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-734b8811-141c-44e9-93a5-dfd16a67b37c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:53.187617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-734b8811-141c-44e9-93a5-dfd16a67b37c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:53.187617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-734b8811-141c-44e9-93a5-dfd16a67b37c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:53.324932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-734b8811-141c-44e9-93a5-dfd16a67b37c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:53.337672 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-734b8811-141c-44e9-93a5-dfd16a67b37c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.164376 Jul 27 20:36:53.338559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 798/1631] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:53 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:54.359305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-10a14c7e-f1c9-43c6-93ff-ca7ebb7625f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:54.360221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-10a14c7e-f1c9-43c6-93ff-ca7ebb7625f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:54.367443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10a14c7e-f1c9-43c6-93ff-ca7ebb7625f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:54.367892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10a14c7e-f1c9-43c6-93ff-ca7ebb7625f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:54.368680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10a14c7e-f1c9-43c6-93ff-ca7ebb7625f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:54.369117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10a14c7e-f1c9-43c6-93ff-ca7ebb7625f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:54.557831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-10a14c7e-f1c9-43c6-93ff-ca7ebb7625f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:54.566789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-10a14c7e-f1c9-43c6-93ff-ca7ebb7625f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.210467 Jul 27 20:36:54.567308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 834/1632] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:54 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:55.589393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5eb6c33a-bc3d-4bd8-a668-10846393078d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:55.590462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5eb6c33a-bc3d-4bd8-a668-10846393078d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:55.599015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5eb6c33a-bc3d-4bd8-a668-10846393078d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:55.599371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5eb6c33a-bc3d-4bd8-a668-10846393078d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:55.600205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5eb6c33a-bc3d-4bd8-a668-10846393078d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:55.600796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5eb6c33a-bc3d-4bd8-a668-10846393078d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:55.775710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5eb6c33a-bc3d-4bd8-a668-10846393078d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:55.784534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5eb6c33a-bc3d-4bd8-a668-10846393078d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.200467 Jul 27 20:36:55.792835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 799/1633] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:55 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:56.811045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-380da666-19d0-4b94-ab68-720e307e3a14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:56.812862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-380da666-19d0-4b94-ab68-720e307e3a14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:56.821735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-380da666-19d0-4b94-ab68-720e307e3a14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:56.822189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-380da666-19d0-4b94-ab68-720e307e3a14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:56.823226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-380da666-19d0-4b94-ab68-720e307e3a14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:56.823669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-380da666-19d0-4b94-ab68-720e307e3a14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:56.827901 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:56.981287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-380da666-19d0-4b94-ab68-720e307e3a14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:56.989999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-380da666-19d0-4b94-ab68-720e307e3a14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.184198 Jul 27 20:36:56.990578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 835/1634] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:56 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:58.011594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6533bf9d-f7c9-441e-83b6-30a5a1a32997 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:58.013014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6533bf9d-f7c9-441e-83b6-30a5a1a32997 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:58.020603 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6533bf9d-f7c9-441e-83b6-30a5a1a32997 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:58.021162 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6533bf9d-f7c9-441e-83b6-30a5a1a32997 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:58.021996 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6533bf9d-f7c9-441e-83b6-30a5a1a32997 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:58.022534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6533bf9d-f7c9-441e-83b6-30a5a1a32997 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:58.160456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6533bf9d-f7c9-441e-83b6-30a5a1a32997 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:58.169287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6533bf9d-f7c9-441e-83b6-30a5a1a32997 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.161622 Jul 27 20:36:58.169871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 800/1635] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:58 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:59.198938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fcc8fe54-3a62-427e-9299-4b40aa5c3f07 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:59.200423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fcc8fe54-3a62-427e-9299-4b40aa5c3f07 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:59.209120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fcc8fe54-3a62-427e-9299-4b40aa5c3f07 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:59.209831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fcc8fe54-3a62-427e-9299-4b40aa5c3f07 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:59.211411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fcc8fe54-3a62-427e-9299-4b40aa5c3f07 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:59.212260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fcc8fe54-3a62-427e-9299-4b40aa5c3f07 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:59.436811 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fcc8fe54-3a62-427e-9299-4b40aa5c3f07 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:59.447826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fcc8fe54-3a62-427e-9299-4b40aa5c3f07 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.259509 Jul 27 20:36:59.466458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 836/1636] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:59 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:00.476407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-27f3e1b0-46ab-4119-841e-3b8710d111f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:00.477984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-27f3e1b0-46ab-4119-841e-3b8710d111f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:00.491929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-27f3e1b0-46ab-4119-841e-3b8710d111f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:00.496993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-27f3e1b0-46ab-4119-841e-3b8710d111f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:00.499970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-27f3e1b0-46ab-4119-841e-3b8710d111f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:00.500678 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-27f3e1b0-46ab-4119-841e-3b8710d111f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:00.683485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-27f3e1b0-46ab-4119-841e-3b8710d111f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:00.692859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-27f3e1b0-46ab-4119-841e-3b8710d111f1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.221319 Jul 27 20:37:00.694090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 801/1637] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:00 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:01.715580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d846615e-9983-4c8b-a24b-061fd16c0626 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:01.716242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d846615e-9983-4c8b-a24b-061fd16c0626 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:01.723215 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d846615e-9983-4c8b-a24b-061fd16c0626 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:01.723656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d846615e-9983-4c8b-a24b-061fd16c0626 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:01.724437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d846615e-9983-4c8b-a24b-061fd16c0626 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:01.724870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d846615e-9983-4c8b-a24b-061fd16c0626 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:01.889068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d846615e-9983-4c8b-a24b-061fd16c0626 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:01.897810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d846615e-9983-4c8b-a24b-061fd16c0626 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.186250 Jul 27 20:37:01.898473 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 837/1638] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:01 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:02.919183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d503e01d-ceb7-430f-8d8e-c787eae3794b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:02.920589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d503e01d-ceb7-430f-8d8e-c787eae3794b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:02.935310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d503e01d-ceb7-430f-8d8e-c787eae3794b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:02.935775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d503e01d-ceb7-430f-8d8e-c787eae3794b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:02.936599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d503e01d-ceb7-430f-8d8e-c787eae3794b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:02.937593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d503e01d-ceb7-430f-8d8e-c787eae3794b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:03.095366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d503e01d-ceb7-430f-8d8e-c787eae3794b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:03.105601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d503e01d-ceb7-430f-8d8e-c787eae3794b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.190632 Jul 27 20:37:03.110350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 838/1639] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:02 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:03.135901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b69ff824-7329-4486-9cc3-a0aad77226f2 tempest-TestVolumeBootPattern-539089574 tempest-TestVolumeBootPattern-539089574-project] Action: 'create', calling method: .version_select at 0x7f35ca49adc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-126043525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXSQ73xGJdy/T7rFKVizILadErAsXg++k2rCv7/MYW3T4ya7dLggSfG1Zk6ZosLut47j97ynZ8VjbcHagL1Inrf/JDZNsnXY1d9MM7XXDfA1+bFqTGtu/lKFYxTVyZ/vw=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:37:03.152207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-b69ff824-7329-4486-9cc3-a0aad77226f2 tempest-TestVolumeBootPattern-539089574 tempest-TestVolumeBootPattern-539089574-project] Getting quotas for project f9befc2c90574dae9c2f9d087b909062. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:37:03.156246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-b69ff824-7329-4486-9cc3-a0aad77226f2 tempest-TestVolumeBootPattern-539089574 tempest-TestVolumeBootPattern-539089574-project] Getting quotas for user 3864d76d4c3b478bad9e5c3c7024a062 and project f9befc2c90574dae9c2f9d087b909062. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:37:03.234085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b69ff824-7329-4486-9cc3-a0aad77226f2 tempest-TestVolumeBootPattern-539089574 tempest-TestVolumeBootPattern-539089574-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.345787 Jul 27 20:37:03.234690 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 802/1640] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:37:02 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:37:04.127447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-07af64af-8494-48d0-871d-93aa600f411f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:04.128069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-07af64af-8494-48d0-871d-93aa600f411f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:04.135304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-07af64af-8494-48d0-871d-93aa600f411f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:04.135754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-07af64af-8494-48d0-871d-93aa600f411f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:04.136591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-07af64af-8494-48d0-871d-93aa600f411f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:04.137030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-07af64af-8494-48d0-871d-93aa600f411f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:04.285970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-07af64af-8494-48d0-871d-93aa600f411f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:04.293999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-07af64af-8494-48d0-871d-93aa600f411f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.170490 Jul 27 20:37:04.294565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 839/1641] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:04 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:05.315738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8a00ff85-fe53-4d23-9e40-117151a72ca8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:05.317074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8a00ff85-fe53-4d23-9e40-117151a72ca8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:05.325132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a00ff85-fe53-4d23-9e40-117151a72ca8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:05.325504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a00ff85-fe53-4d23-9e40-117151a72ca8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:05.326295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a00ff85-fe53-4d23-9e40-117151a72ca8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:05.326861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a00ff85-fe53-4d23-9e40-117151a72ca8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:05.499381 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8a00ff85-fe53-4d23-9e40-117151a72ca8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:05.508818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8a00ff85-fe53-4d23-9e40-117151a72ca8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.197507 Jul 27 20:37:05.509587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 803/1642] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:05 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:06.531301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8ad1513c-f009-488d-a000-0c71f74a6c57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:06.532061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8ad1513c-f009-488d-a000-0c71f74a6c57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:06.539697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ad1513c-f009-488d-a000-0c71f74a6c57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:06.540285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ad1513c-f009-488d-a000-0c71f74a6c57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:06.541179 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ad1513c-f009-488d-a000-0c71f74a6c57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:06.541706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ad1513c-f009-488d-a000-0c71f74a6c57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:06.693053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ad1513c-f009-488d-a000-0c71f74a6c57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:06.700962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8ad1513c-f009-488d-a000-0c71f74a6c57 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.174500 Jul 27 20:37:06.701541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 840/1643] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:06 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:07.581660 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:37:07.582125 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:37:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:37:07.723068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b8311a64-0ba0-4641-8ff9-1e40caf28619 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:07.723604 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b8311a64-0ba0-4641-8ff9-1e40caf28619 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:07.730033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8311a64-0ba0-4641-8ff9-1e40caf28619 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:07.730474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8311a64-0ba0-4641-8ff9-1e40caf28619 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:07.731222 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8311a64-0ba0-4641-8ff9-1e40caf28619 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:07.731650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b8311a64-0ba0-4641-8ff9-1e40caf28619 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:07.856149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b8311a64-0ba0-4641-8ff9-1e40caf28619 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:07.864797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b8311a64-0ba0-4641-8ff9-1e40caf28619 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146071 Jul 27 20:37:07.865369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 804/1644] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:07 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:08.885217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-74e21a11-1f85-4512-a636-ec72b58903bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:08.885746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-74e21a11-1f85-4512-a636-ec72b58903bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:08.892146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74e21a11-1f85-4512-a636-ec72b58903bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:08.892624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74e21a11-1f85-4512-a636-ec72b58903bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:08.893369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74e21a11-1f85-4512-a636-ec72b58903bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:08.894290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74e21a11-1f85-4512-a636-ec72b58903bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:09.026598 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74e21a11-1f85-4512-a636-ec72b58903bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:09.035655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-74e21a11-1f85-4512-a636-ec72b58903bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154324 Jul 27 20:37:09.036227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 841/1645] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:08 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:10.057352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1f6292bb-e02e-4c6d-a5db-ec1f6cc245a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:10.057913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1f6292bb-e02e-4c6d-a5db-ec1f6cc245a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:10.064420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f6292bb-e02e-4c6d-a5db-ec1f6cc245a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:10.064874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f6292bb-e02e-4c6d-a5db-ec1f6cc245a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:10.065642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f6292bb-e02e-4c6d-a5db-ec1f6cc245a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:10.066084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f6292bb-e02e-4c6d-a5db-ec1f6cc245a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:10.190352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1f6292bb-e02e-4c6d-a5db-ec1f6cc245a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:10.198259 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1f6292bb-e02e-4c6d-a5db-ec1f6cc245a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.144917 Jul 27 20:37:10.198856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 805/1646] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:10 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:11.220880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd1a6d91-19c2-4d02-a1c6-3ee3460fbfa9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:11.222408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fd1a6d91-19c2-4d02-a1c6-3ee3460fbfa9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:11.229773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d91-19c2-4d02-a1c6-3ee3460fbfa9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:11.230286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d91-19c2-4d02-a1c6-3ee3460fbfa9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:11.231033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d91-19c2-4d02-a1c6-3ee3460fbfa9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:11.231464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d91-19c2-4d02-a1c6-3ee3460fbfa9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:11.362605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd1a6d91-19c2-4d02-a1c6-3ee3460fbfa9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:11.371210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd1a6d91-19c2-4d02-a1c6-3ee3460fbfa9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154924 Jul 27 20:37:11.371772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 842/1647] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:11 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:12.393378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-750f7f21-b7de-438b-993c-017416c732f3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:12.393994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-750f7f21-b7de-438b-993c-017416c732f3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:12.396338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:12.401173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-750f7f21-b7de-438b-993c-017416c732f3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:12.401630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-750f7f21-b7de-438b-993c-017416c732f3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:12.402391 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-750f7f21-b7de-438b-993c-017416c732f3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:12.402829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-750f7f21-b7de-438b-993c-017416c732f3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:12.538471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-750f7f21-b7de-438b-993c-017416c732f3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:12.546372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-750f7f21-b7de-438b-993c-017416c732f3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.156887 Jul 27 20:37:12.551399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 806/1648] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:12 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:13.566981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2ca48a96-2e6e-4be6-833c-daa4cc8353bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:13.567585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2ca48a96-2e6e-4be6-833c-daa4cc8353bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:13.569935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:13.574591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ca48a96-2e6e-4be6-833c-daa4cc8353bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:13.575034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ca48a96-2e6e-4be6-833c-daa4cc8353bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:13.575773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ca48a96-2e6e-4be6-833c-daa4cc8353bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:13.576245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ca48a96-2e6e-4be6-833c-daa4cc8353bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:13.704583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ca48a96-2e6e-4be6-833c-daa4cc8353bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:13.713021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2ca48a96-2e6e-4be6-833c-daa4cc8353bc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149884 Jul 27 20:37:13.713582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 843/1649] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:13 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:14.734151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-57101510-1cc4-483d-a865-6e3b2d8eafcd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:14.734766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-57101510-1cc4-483d-a865-6e3b2d8eafcd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:14.736679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:14.742093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57101510-1cc4-483d-a865-6e3b2d8eafcd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:14.742546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57101510-1cc4-483d-a865-6e3b2d8eafcd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:14.743302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57101510-1cc4-483d-a865-6e3b2d8eafcd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:14.743737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57101510-1cc4-483d-a865-6e3b2d8eafcd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:14.871912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-57101510-1cc4-483d-a865-6e3b2d8eafcd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:14.880363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-57101510-1cc4-483d-a865-6e3b2d8eafcd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150277 Jul 27 20:37:14.880950 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 807/1650] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:14 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:15.903622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ecdf70d-30a9-4654-a35c-f62a3c8fe262 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:15.904226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ecdf70d-30a9-4654-a35c-f62a3c8fe262 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:15.911090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ecdf70d-30a9-4654-a35c-f62a3c8fe262 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:15.911527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ecdf70d-30a9-4654-a35c-f62a3c8fe262 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:15.912266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ecdf70d-30a9-4654-a35c-f62a3c8fe262 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:15.912721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ecdf70d-30a9-4654-a35c-f62a3c8fe262 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:16.038657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ecdf70d-30a9-4654-a35c-f62a3c8fe262 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:16.046375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ecdf70d-30a9-4654-a35c-f62a3c8fe262 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146635 Jul 27 20:37:16.046954 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 844/1651] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:15 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:17.067796 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f5b1387-f6f7-4cb9-a4f9-0154bd5c422c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:17.068318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6f5b1387-f6f7-4cb9-a4f9-0154bd5c422c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:17.074776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f5b1387-f6f7-4cb9-a4f9-0154bd5c422c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:17.075225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f5b1387-f6f7-4cb9-a4f9-0154bd5c422c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:17.075970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f5b1387-f6f7-4cb9-a4f9-0154bd5c422c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:17.076420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f5b1387-f6f7-4cb9-a4f9-0154bd5c422c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:17.080219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=72 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:17.203985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6f5b1387-f6f7-4cb9-a4f9-0154bd5c422c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:17.211892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6f5b1387-f6f7-4cb9-a4f9-0154bd5c422c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148733 Jul 27 20:37:17.212480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 808/1652] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:17 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:18.233104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c9ae18a2-b58b-485e-86cd-3af599da4cd3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:18.233715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c9ae18a2-b58b-485e-86cd-3af599da4cd3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:18.240113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9ae18a2-b58b-485e-86cd-3af599da4cd3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.240661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9ae18a2-b58b-485e-86cd-3af599da4cd3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.241413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9ae18a2-b58b-485e-86cd-3af599da4cd3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.241841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c9ae18a2-b58b-485e-86cd-3af599da4cd3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.370015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c9ae18a2-b58b-485e-86cd-3af599da4cd3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:18.378179 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c9ae18a2-b58b-485e-86cd-3af599da4cd3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149071 Jul 27 20:37:18.379236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 845/1653] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:18 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:19.400185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f9852d9-df87-4b2d-8b9b-f0f44c2a0f3d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:19.400837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6f9852d9-df87-4b2d-8b9b-f0f44c2a0f3d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:19.407417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f9852d9-df87-4b2d-8b9b-f0f44c2a0f3d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:19.407881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f9852d9-df87-4b2d-8b9b-f0f44c2a0f3d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:19.408674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f9852d9-df87-4b2d-8b9b-f0f44c2a0f3d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:19.409116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f9852d9-df87-4b2d-8b9b-f0f44c2a0f3d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:19.537985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6f9852d9-df87-4b2d-8b9b-f0f44c2a0f3d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:19.545903 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6f9852d9-df87-4b2d-8b9b-f0f44c2a0f3d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149595 Jul 27 20:37:19.546471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 809/1654] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:19 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:20.567672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-882be9af-7ffe-43bc-bbc3-a9e4c6027047 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:20.568275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-882be9af-7ffe-43bc-bbc3-a9e4c6027047 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:20.576470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-882be9af-7ffe-43bc-bbc3-a9e4c6027047 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:20.577327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-882be9af-7ffe-43bc-bbc3-a9e4c6027047 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:20.578574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-882be9af-7ffe-43bc-bbc3-a9e4c6027047 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:20.579018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-882be9af-7ffe-43bc-bbc3-a9e4c6027047 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:20.955553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-882be9af-7ffe-43bc-bbc3-a9e4c6027047 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:20.963347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-882be9af-7ffe-43bc-bbc3-a9e4c6027047 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.400139 Jul 27 20:37:20.963907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 846/1655] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:20 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:21.984473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a450b579-71be-4871-a19c-7a50ab82a0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:21.985088 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a450b579-71be-4871-a19c-7a50ab82a0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:21.992220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a450b579-71be-4871-a19c-7a50ab82a0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:21.992704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a450b579-71be-4871-a19c-7a50ab82a0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:21.993494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a450b579-71be-4871-a19c-7a50ab82a0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:21.993930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a450b579-71be-4871-a19c-7a50ab82a0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:22.118184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a450b579-71be-4871-a19c-7a50ab82a0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:22.126263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a450b579-71be-4871-a19c-7a50ab82a0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145741 Jul 27 20:37:22.126828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 810/1656] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:21 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:23.146922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-14023294-2859-4e8a-b6c1-98b90ba12b09 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:23.147530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-14023294-2859-4e8a-b6c1-98b90ba12b09 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:23.153987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-14023294-2859-4e8a-b6c1-98b90ba12b09 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:23.154431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-14023294-2859-4e8a-b6c1-98b90ba12b09 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:23.155182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-14023294-2859-4e8a-b6c1-98b90ba12b09 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:23.155610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-14023294-2859-4e8a-b6c1-98b90ba12b09 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:23.283698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-14023294-2859-4e8a-b6c1-98b90ba12b09 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:23.292150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-14023294-2859-4e8a-b6c1-98b90ba12b09 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149104 Jul 27 20:37:23.292740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 847/1657] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:23 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:24.313027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-612507ac-78fe-4aa9-86ec-5a14e123e862 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:24.313642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-612507ac-78fe-4aa9-86ec-5a14e123e862 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:24.320621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-612507ac-78fe-4aa9-86ec-5a14e123e862 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:24.321075 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-612507ac-78fe-4aa9-86ec-5a14e123e862 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:24.321835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-612507ac-78fe-4aa9-86ec-5a14e123e862 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:24.322270 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-612507ac-78fe-4aa9-86ec-5a14e123e862 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:24.449561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-612507ac-78fe-4aa9-86ec-5a14e123e862 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:24.458124 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-612507ac-78fe-4aa9-86ec-5a14e123e862 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148990 Jul 27 20:37:24.458687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 811/1658] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:24 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:25.479788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2da7c88a-b417-434a-9653-b76605de389b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:25.480404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2da7c88a-b417-434a-9653-b76605de389b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:25.486436 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2da7c88a-b417-434a-9653-b76605de389b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:25.486881 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2da7c88a-b417-434a-9653-b76605de389b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:25.487629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2da7c88a-b417-434a-9653-b76605de389b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:25.488059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2da7c88a-b417-434a-9653-b76605de389b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:25.618757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2da7c88a-b417-434a-9653-b76605de389b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:25.626877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2da7c88a-b417-434a-9653-b76605de389b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151129 Jul 27 20:37:25.627466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 848/1659] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:25 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:26.648927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bb8f0e42-6e86-4bcb-acb0-f4eadcd87e1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:26.649467 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bb8f0e42-6e86-4bcb-acb0-f4eadcd87e1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:26.656080 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb8f0e42-6e86-4bcb-acb0-f4eadcd87e1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:26.656640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb8f0e42-6e86-4bcb-acb0-f4eadcd87e1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:26.657403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb8f0e42-6e86-4bcb-acb0-f4eadcd87e1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:26.657844 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb8f0e42-6e86-4bcb-acb0-f4eadcd87e1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:26.787975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bb8f0e42-6e86-4bcb-acb0-f4eadcd87e1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:26.795789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bb8f0e42-6e86-4bcb-acb0-f4eadcd87e1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151501 Jul 27 20:37:26.796348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 812/1660] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:26 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:27.817380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c87c7c4d-bf1f-48f5-a0b9-f779d2964049 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:27.817992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c87c7c4d-bf1f-48f5-a0b9-f779d2964049 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:27.824433 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c87c7c4d-bf1f-48f5-a0b9-f779d2964049 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:27.824883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c87c7c4d-bf1f-48f5-a0b9-f779d2964049 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:27.825640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c87c7c4d-bf1f-48f5-a0b9-f779d2964049 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:27.826076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c87c7c4d-bf1f-48f5-a0b9-f779d2964049 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:27.951248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c87c7c4d-bf1f-48f5-a0b9-f779d2964049 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:27.960904 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c87c7c4d-bf1f-48f5-a0b9-f779d2964049 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147346 Jul 27 20:37:27.961486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 849/1661] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:27 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:28.982778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b1e2c583-e701-47ba-8efa-cbc308e0625c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:28.983425 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b1e2c583-e701-47ba-8efa-cbc308e0625c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:28.989980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1e2c583-e701-47ba-8efa-cbc308e0625c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:28.990430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1e2c583-e701-47ba-8efa-cbc308e0625c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:28.991187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1e2c583-e701-47ba-8efa-cbc308e0625c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:28.991630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1e2c583-e701-47ba-8efa-cbc308e0625c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:29.122376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b1e2c583-e701-47ba-8efa-cbc308e0625c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:29.130276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b1e2c583-e701-47ba-8efa-cbc308e0625c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151436 Jul 27 20:37:29.130851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 813/1662] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:28 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:30.151311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c3d9b0b2-90e4-4cc1-9bc4-bb6a2e175274 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:30.151967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c3d9b0b2-90e4-4cc1-9bc4-bb6a2e175274 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:30.158311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3d9b0b2-90e4-4cc1-9bc4-bb6a2e175274 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:30.158753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3d9b0b2-90e4-4cc1-9bc4-bb6a2e175274 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:30.159998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3d9b0b2-90e4-4cc1-9bc4-bb6a2e175274 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:30.160447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3d9b0b2-90e4-4cc1-9bc4-bb6a2e175274 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:30.162966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=90 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:30.286190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c3d9b0b2-90e4-4cc1-9bc4-bb6a2e175274 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:30.294125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c3d9b0b2-90e4-4cc1-9bc4-bb6a2e175274 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146647 Jul 27 20:37:30.294695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 850/1663] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:30 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:31.315869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8a8863e4-13c1-4086-bee2-163256ac5e7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:31.316542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8a8863e4-13c1-4086-bee2-163256ac5e7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:31.322980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a8863e4-13c1-4086-bee2-163256ac5e7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:31.328276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a8863e4-13c1-4086-bee2-163256ac5e7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:31.328276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a8863e4-13c1-4086-bee2-163256ac5e7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:31.328276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a8863e4-13c1-4086-bee2-163256ac5e7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:31.456054 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8a8863e4-13c1-4086-bee2-163256ac5e7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:31.464427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8a8863e4-13c1-4086-bee2-163256ac5e7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152462 Jul 27 20:37:31.464990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 814/1664] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:31 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:32.490030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c05f479f-7230-4a40-938d-905679cde6cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:32.490678 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c05f479f-7230-4a40-938d-905679cde6cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:32.497473 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c05f479f-7230-4a40-938d-905679cde6cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:32.497926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c05f479f-7230-4a40-938d-905679cde6cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:32.498691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c05f479f-7230-4a40-938d-905679cde6cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:32.499128 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c05f479f-7230-4a40-938d-905679cde6cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:32.623942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c05f479f-7230-4a40-938d-905679cde6cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:32.632437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c05f479f-7230-4a40-938d-905679cde6cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146248 Jul 27 20:37:32.633010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 851/1665] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:32 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:33.654853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c3558c76-d860-4db4-bdd0-c4bb71789239 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:33.655418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c3558c76-d860-4db4-bdd0-c4bb71789239 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:33.661861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c3558c76-d860-4db4-bdd0-c4bb71789239 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:33.662301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c3558c76-d860-4db4-bdd0-c4bb71789239 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:33.663044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c3558c76-d860-4db4-bdd0-c4bb71789239 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:33.663471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c3558c76-d860-4db4-bdd0-c4bb71789239 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:33.788762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c3558c76-d860-4db4-bdd0-c4bb71789239 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:33.796713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c3558c76-d860-4db4-bdd0-c4bb71789239 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145893 Jul 27 20:37:33.797278 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 815/1666] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:33 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:34.818474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d2931465-9304-4457-8aa2-6c7999a70211 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:34.819092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d2931465-9304-4457-8aa2-6c7999a70211 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:34.825532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d2931465-9304-4457-8aa2-6c7999a70211 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:34.825979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d2931465-9304-4457-8aa2-6c7999a70211 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:34.826763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d2931465-9304-4457-8aa2-6c7999a70211 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:34.827197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d2931465-9304-4457-8aa2-6c7999a70211 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:34.955458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d2931465-9304-4457-8aa2-6c7999a70211 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:34.963934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d2931465-9304-4457-8aa2-6c7999a70211 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149843 Jul 27 20:37:34.964574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 852/1667] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:34 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:35.985485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c70122de-82e2-44a3-b641-4613d0a0b995 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:35.986097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c70122de-82e2-44a3-b641-4613d0a0b995 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:35.993210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c70122de-82e2-44a3-b641-4613d0a0b995 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:35.993655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c70122de-82e2-44a3-b641-4613d0a0b995 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:35.994408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c70122de-82e2-44a3-b641-4613d0a0b995 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:35.994840 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c70122de-82e2-44a3-b641-4613d0a0b995 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:36.124921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c70122de-82e2-44a3-b641-4613d0a0b995 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:36.132713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c70122de-82e2-44a3-b641-4613d0a0b995 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151128 Jul 27 20:37:36.133287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 816/1668] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:35 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:37.154004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-889fdb9f-dcbf-4e21-be4f-6bfd2a78024d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:37.154621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-889fdb9f-dcbf-4e21-be4f-6bfd2a78024d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:37.161675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-889fdb9f-dcbf-4e21-be4f-6bfd2a78024d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:37.162117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-889fdb9f-dcbf-4e21-be4f-6bfd2a78024d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:37.162869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-889fdb9f-dcbf-4e21-be4f-6bfd2a78024d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:37.163302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-889fdb9f-dcbf-4e21-be4f-6bfd2a78024d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:37.292194 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-889fdb9f-dcbf-4e21-be4f-6bfd2a78024d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:37.300080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-889fdb9f-dcbf-4e21-be4f-6bfd2a78024d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149949 Jul 27 20:37:37.300688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 853/1669] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:37 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:38.321722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-76280735-ee4d-40bb-b3b9-947be10041aa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:38.322308 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-76280735-ee4d-40bb-b3b9-947be10041aa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:38.328894 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76280735-ee4d-40bb-b3b9-947be10041aa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:38.329339 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76280735-ee4d-40bb-b3b9-947be10041aa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:38.330089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76280735-ee4d-40bb-b3b9-947be10041aa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:38.330515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76280735-ee4d-40bb-b3b9-947be10041aa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:38.457171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-76280735-ee4d-40bb-b3b9-947be10041aa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:38.465131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-76280735-ee4d-40bb-b3b9-947be10041aa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147271 Jul 27 20:37:38.465700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 817/1670] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:38 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:39.486083 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8216489c-1673-44d5-81fa-b3972f8d1de4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:39.486700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8216489c-1673-44d5-81fa-b3972f8d1de4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:39.493836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8216489c-1673-44d5-81fa-b3972f8d1de4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:39.494286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8216489c-1673-44d5-81fa-b3972f8d1de4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:39.495053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8216489c-1673-44d5-81fa-b3972f8d1de4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:39.495489 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8216489c-1673-44d5-81fa-b3972f8d1de4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:39.629400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8216489c-1673-44d5-81fa-b3972f8d1de4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:39.637590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8216489c-1673-44d5-81fa-b3972f8d1de4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.155366 Jul 27 20:37:39.638158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 854/1671] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:39 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:40.664624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d90c3358-3317-49fa-94cc-5823f88ec657 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:40.665244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d90c3358-3317-49fa-94cc-5823f88ec657 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:40.671706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d90c3358-3317-49fa-94cc-5823f88ec657 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:40.672159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d90c3358-3317-49fa-94cc-5823f88ec657 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:40.673035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d90c3358-3317-49fa-94cc-5823f88ec657 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:40.673476 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d90c3358-3317-49fa-94cc-5823f88ec657 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:40.872711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d90c3358-3317-49fa-94cc-5823f88ec657 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:40.881264 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d90c3358-3317-49fa-94cc-5823f88ec657 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.220604 Jul 27 20:37:40.881848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 818/1672] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:40 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:41.902757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4d87657b-f900-4f11-9026-35004ece9646 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:41.903371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4d87657b-f900-4f11-9026-35004ece9646 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:41.909860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d87657b-f900-4f11-9026-35004ece9646 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:41.910314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d87657b-f900-4f11-9026-35004ece9646 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:41.911071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d87657b-f900-4f11-9026-35004ece9646 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:41.911507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d87657b-f900-4f11-9026-35004ece9646 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:42.045136 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4d87657b-f900-4f11-9026-35004ece9646 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:42.053650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4d87657b-f900-4f11-9026-35004ece9646 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154766 Jul 27 20:37:42.054271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 855/1673] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:41 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:43.075224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4b536a07-f5dd-41f2-8044-0baa8de1ec3a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:43.075839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4b536a07-f5dd-41f2-8044-0baa8de1ec3a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:43.078234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=26 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:43.082991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4b536a07-f5dd-41f2-8044-0baa8de1ec3a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:43.083447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4b536a07-f5dd-41f2-8044-0baa8de1ec3a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:43.084206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4b536a07-f5dd-41f2-8044-0baa8de1ec3a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:43.084671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4b536a07-f5dd-41f2-8044-0baa8de1ec3a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:43.212940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4b536a07-f5dd-41f2-8044-0baa8de1ec3a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:43.220781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4b536a07-f5dd-41f2-8044-0baa8de1ec3a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149545 Jul 27 20:37:43.221359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 819/1674] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:43 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:44.242624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-014337b0-76de-45a8-8cf4-b75eb19ee88d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:44.243230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-014337b0-76de-45a8-8cf4-b75eb19ee88d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:44.245563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=26 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:44.250743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-014337b0-76de-45a8-8cf4-b75eb19ee88d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:44.251193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-014337b0-76de-45a8-8cf4-b75eb19ee88d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:44.251952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-014337b0-76de-45a8-8cf4-b75eb19ee88d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:44.252518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-014337b0-76de-45a8-8cf4-b75eb19ee88d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:44.382282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-014337b0-76de-45a8-8cf4-b75eb19ee88d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:44.390318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-014337b0-76de-45a8-8cf4-b75eb19ee88d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151549 Jul 27 20:37:44.390882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 856/1675] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:44 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:45.411263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4d9dfda9-0436-4ae8-aa9d-52b37701b838 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:45.411999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4d9dfda9-0436-4ae8-aa9d-52b37701b838 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:45.418114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d9dfda9-0436-4ae8-aa9d-52b37701b838 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:45.418566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d9dfda9-0436-4ae8-aa9d-52b37701b838 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:45.419344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d9dfda9-0436-4ae8-aa9d-52b37701b838 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:45.419815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d9dfda9-0436-4ae8-aa9d-52b37701b838 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:45.550380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4d9dfda9-0436-4ae8-aa9d-52b37701b838 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:45.558184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4d9dfda9-0436-4ae8-aa9d-52b37701b838 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151009 Jul 27 20:37:45.558757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 820/1676] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:45 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:46.580108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-01ca69ae-8de8-4457-bcad-d0404c8929ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:46.580686 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-01ca69ae-8de8-4457-bcad-d0404c8929ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:46.587108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01ca69ae-8de8-4457-bcad-d0404c8929ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:46.587556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01ca69ae-8de8-4457-bcad-d0404c8929ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:46.588311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01ca69ae-8de8-4457-bcad-d0404c8929ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:46.588776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-01ca69ae-8de8-4457-bcad-d0404c8929ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:46.714994 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-01ca69ae-8de8-4457-bcad-d0404c8929ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:46.723363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-01ca69ae-8de8-4457-bcad-d0404c8929ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147176 Jul 27 20:37:46.723938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 857/1677] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:46 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:47.745724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b634490d-e988-45c3-a285-24d752e7e4ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:47.746622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b634490d-e988-45c3-a285-24d752e7e4ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:47.754377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b634490d-e988-45c3-a285-24d752e7e4ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:47.754819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b634490d-e988-45c3-a285-24d752e7e4ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:47.755645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b634490d-e988-45c3-a285-24d752e7e4ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:47.756078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b634490d-e988-45c3-a285-24d752e7e4ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:47.758609 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=78 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:47.890379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b634490d-e988-45c3-a285-24d752e7e4ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:47.900642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b634490d-e988-45c3-a285-24d752e7e4ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.159599 Jul 27 20:37:47.901213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 821/1678] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:47 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:48.923094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-093fb03a-7a95-42a7-9892-4278b321904e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:48.923714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-093fb03a-7a95-42a7-9892-4278b321904e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:48.930888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-093fb03a-7a95-42a7-9892-4278b321904e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:48.931335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-093fb03a-7a95-42a7-9892-4278b321904e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:48.932093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-093fb03a-7a95-42a7-9892-4278b321904e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:48.932557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-093fb03a-7a95-42a7-9892-4278b321904e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:49.061105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-093fb03a-7a95-42a7-9892-4278b321904e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:49.069141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-093fb03a-7a95-42a7-9892-4278b321904e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150004 Jul 27 20:37:49.069707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 858/1679] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:48 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:50.090353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aab1e34e-1a03-4a43-84c6-b5a5643d39a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:50.090997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aab1e34e-1a03-4a43-84c6-b5a5643d39a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:50.097595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aab1e34e-1a03-4a43-84c6-b5a5643d39a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:50.098040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aab1e34e-1a03-4a43-84c6-b5a5643d39a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:50.098794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aab1e34e-1a03-4a43-84c6-b5a5643d39a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:50.099226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aab1e34e-1a03-4a43-84c6-b5a5643d39a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:50.224027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aab1e34e-1a03-4a43-84c6-b5a5643d39a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:50.231875 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aab1e34e-1a03-4a43-84c6-b5a5643d39a1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145416 Jul 27 20:37:50.232459 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 822/1680] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:50 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:51.253397 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-06f92837-62a4-4f4a-b17a-d9df540db464 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:51.254064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-06f92837-62a4-4f4a-b17a-d9df540db464 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:51.260441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06f92837-62a4-4f4a-b17a-d9df540db464 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:51.260888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06f92837-62a4-4f4a-b17a-d9df540db464 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:51.261632 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06f92837-62a4-4f4a-b17a-d9df540db464 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:51.262059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06f92837-62a4-4f4a-b17a-d9df540db464 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:51.392798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-06f92837-62a4-4f4a-b17a-d9df540db464 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:51.401567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-06f92837-62a4-4f4a-b17a-d9df540db464 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151967 Jul 27 20:37:51.403487 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 859/1681] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:51 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:52.422938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-117bf5ab-c825-4627-afc0-2ba17a6896fd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:52.423556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-117bf5ab-c825-4627-afc0-2ba17a6896fd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:52.430553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-117bf5ab-c825-4627-afc0-2ba17a6896fd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:52.431205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-117bf5ab-c825-4627-afc0-2ba17a6896fd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:52.431792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-117bf5ab-c825-4627-afc0-2ba17a6896fd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:52.432172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-117bf5ab-c825-4627-afc0-2ba17a6896fd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:52.556941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-117bf5ab-c825-4627-afc0-2ba17a6896fd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:52.564784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-117bf5ab-c825-4627-afc0-2ba17a6896fd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145728 Jul 27 20:37:52.565353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 823/1682] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:52 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:53.587003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-531d17b2-286d-4f9e-8eb4-227dadf2413b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:53.587622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-531d17b2-286d-4f9e-8eb4-227dadf2413b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:53.594168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-531d17b2-286d-4f9e-8eb4-227dadf2413b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:53.594561 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-531d17b2-286d-4f9e-8eb4-227dadf2413b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:53.595317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-531d17b2-286d-4f9e-8eb4-227dadf2413b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:53.595747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-531d17b2-286d-4f9e-8eb4-227dadf2413b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:53.725296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-531d17b2-286d-4f9e-8eb4-227dadf2413b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:53.733088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-531d17b2-286d-4f9e-8eb4-227dadf2413b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149978 Jul 27 20:37:53.733665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 860/1683] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:53 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:54.755820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-05d928a9-90ce-45aa-ab62-77d1c1084ba2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:54.756473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-05d928a9-90ce-45aa-ab62-77d1c1084ba2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:54.763000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05d928a9-90ce-45aa-ab62-77d1c1084ba2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:54.763449 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05d928a9-90ce-45aa-ab62-77d1c1084ba2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:54.764239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05d928a9-90ce-45aa-ab62-77d1c1084ba2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:54.764710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05d928a9-90ce-45aa-ab62-77d1c1084ba2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:54.891787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-05d928a9-90ce-45aa-ab62-77d1c1084ba2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:54.899869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-05d928a9-90ce-45aa-ab62-77d1c1084ba2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148542 Jul 27 20:37:54.900461 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 824/1684] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:54 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:55.921592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-365477f9-e7d4-4ac2-839b-dd4c2bc83899 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:55.922200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-365477f9-e7d4-4ac2-839b-dd4c2bc83899 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:55.928990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-365477f9-e7d4-4ac2-839b-dd4c2bc83899 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:55.929435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-365477f9-e7d4-4ac2-839b-dd4c2bc83899 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:55.930186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-365477f9-e7d4-4ac2-839b-dd4c2bc83899 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:55.930615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-365477f9-e7d4-4ac2-839b-dd4c2bc83899 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:56.059497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-365477f9-e7d4-4ac2-839b-dd4c2bc83899 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:56.067393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-365477f9-e7d4-4ac2-839b-dd4c2bc83899 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149743 Jul 27 20:37:56.067962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 861/1685] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:55 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:57.089152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9338b7c6-42ab-48a0-acff-4d6e32a26ffd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:57.089751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9338b7c6-42ab-48a0-acff-4d6e32a26ffd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:57.096482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9338b7c6-42ab-48a0-acff-4d6e32a26ffd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:57.096930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9338b7c6-42ab-48a0-acff-4d6e32a26ffd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:57.097684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9338b7c6-42ab-48a0-acff-4d6e32a26ffd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:57.098118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9338b7c6-42ab-48a0-acff-4d6e32a26ffd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:57.222728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9338b7c6-42ab-48a0-acff-4d6e32a26ffd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:57.230564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9338b7c6-42ab-48a0-acff-4d6e32a26ffd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145277 Jul 27 20:37:57.231127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 825/1686] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:57 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:58.252008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-43f733ed-4f79-4a86-9266-7d68876b2ca5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:58.252639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-43f733ed-4f79-4a86-9266-7d68876b2ca5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:58.259799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43f733ed-4f79-4a86-9266-7d68876b2ca5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:58.260239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43f733ed-4f79-4a86-9266-7d68876b2ca5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:58.261026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43f733ed-4f79-4a86-9266-7d68876b2ca5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:58.261464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43f733ed-4f79-4a86-9266-7d68876b2ca5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:58.389529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-43f733ed-4f79-4a86-9266-7d68876b2ca5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:58.397550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-43f733ed-4f79-4a86-9266-7d68876b2ca5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149458 Jul 27 20:37:58.398128 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 862/1687] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:58 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:59.418827 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d72c6627-3583-45bc-9131-7b4b5ef26061 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:59.419440 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d72c6627-3583-45bc-9131-7b4b5ef26061 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:59.426031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d72c6627-3583-45bc-9131-7b4b5ef26061 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:59.426482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d72c6627-3583-45bc-9131-7b4b5ef26061 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:59.427241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d72c6627-3583-45bc-9131-7b4b5ef26061 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:59.427682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d72c6627-3583-45bc-9131-7b4b5ef26061 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:59.557339 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d72c6627-3583-45bc-9131-7b4b5ef26061 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:59.565324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d72c6627-3583-45bc-9131-7b4b5ef26061 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150440 Jul 27 20:37:59.565883 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 826/1688] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:59 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:00.587264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6be28809-36f0-418d-a8ad-b8cdeb968fff tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:00.587879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6be28809-36f0-418d-a8ad-b8cdeb968fff tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:00.594441 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6be28809-36f0-418d-a8ad-b8cdeb968fff tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:00.594829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6be28809-36f0-418d-a8ad-b8cdeb968fff tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:00.595581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6be28809-36f0-418d-a8ad-b8cdeb968fff tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:00.596014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6be28809-36f0-418d-a8ad-b8cdeb968fff tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:00.599166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=78 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:00.724790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6be28809-36f0-418d-a8ad-b8cdeb968fff tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:00.733591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6be28809-36f0-418d-a8ad-b8cdeb968fff tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150147 Jul 27 20:38:00.734166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 863/1689] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:00 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:01.755766 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-16f6f1ab-3736-4200-bd1a-80f132b24584 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:01.756402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-16f6f1ab-3736-4200-bd1a-80f132b24584 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:01.763063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16f6f1ab-3736-4200-bd1a-80f132b24584 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:01.763520 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16f6f1ab-3736-4200-bd1a-80f132b24584 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:01.764321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16f6f1ab-3736-4200-bd1a-80f132b24584 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:01.764794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-16f6f1ab-3736-4200-bd1a-80f132b24584 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:01.892751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-16f6f1ab-3736-4200-bd1a-80f132b24584 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:01.900649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-16f6f1ab-3736-4200-bd1a-80f132b24584 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148833 Jul 27 20:38:01.901226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 827/1690] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:01 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:02.922423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bbeb0b20-5f37-467a-bf95-7680a134bab4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:02.923039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bbeb0b20-5f37-467a-bf95-7680a134bab4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:02.929518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbeb0b20-5f37-467a-bf95-7680a134bab4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:02.929963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbeb0b20-5f37-467a-bf95-7680a134bab4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:02.930716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbeb0b20-5f37-467a-bf95-7680a134bab4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:02.931147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbeb0b20-5f37-467a-bf95-7680a134bab4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:03.057993 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bbeb0b20-5f37-467a-bf95-7680a134bab4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:03.066495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bbeb0b20-5f37-467a-bf95-7680a134bab4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147857 Jul 27 20:38:03.067575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 864/1691] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:02 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:04.087555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ec82c1d2-bd1e-410e-b232-a74fc285c8f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:04.088173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ec82c1d2-bd1e-410e-b232-a74fc285c8f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:04.094663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec82c1d2-bd1e-410e-b232-a74fc285c8f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:04.095115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec82c1d2-bd1e-410e-b232-a74fc285c8f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:04.095880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec82c1d2-bd1e-410e-b232-a74fc285c8f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:04.096320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec82c1d2-bd1e-410e-b232-a74fc285c8f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:04.226252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ec82c1d2-bd1e-410e-b232-a74fc285c8f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:04.234236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ec82c1d2-bd1e-410e-b232-a74fc285c8f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150584 Jul 27 20:38:04.234808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 828/1692] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:04 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:05.256591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4e2e2b78-9669-480b-a56b-34083c584770 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:05.257205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4e2e2b78-9669-480b-a56b-34083c584770 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:05.263699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e2e2b78-9669-480b-a56b-34083c584770 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:05.264146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e2e2b78-9669-480b-a56b-34083c584770 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:05.264942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e2e2b78-9669-480b-a56b-34083c584770 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:05.265374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e2e2b78-9669-480b-a56b-34083c584770 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:05.397830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4e2e2b78-9669-480b-a56b-34083c584770 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:05.405947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4e2e2b78-9669-480b-a56b-34083c584770 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153908 Jul 27 20:38:05.406551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 865/1693] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:05 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:06.144650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e4f17ccb-2964-47f5-8b7f-c2b1c9076ce4 tempest-TestVolumeBootPattern-539089574 tempest-TestVolumeBootPattern-539089574-project] Calling method '.version_select at 0x7f35cadbb280>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:06.227115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e4f17ccb-2964-47f5-8b7f-c2b1c9076ce4 tempest-TestVolumeBootPattern-539089574 tempest-TestVolumeBootPattern-539089574-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-126043525" status: 202 len: 0 microversion: 2.1 time: 0.086283 Jul 27 20:38:06.227712 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 829/1694] 10.222.0.47 () {58 vars in 1260 bytes} [Wed Jul 27 20:38:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-126043525 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:38:06.428079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d404c422-d387-4cdd-b37a-c92e696901b1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:06.428728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d404c422-d387-4cdd-b37a-c92e696901b1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:06.435387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d404c422-d387-4cdd-b37a-c92e696901b1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:06.435775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d404c422-d387-4cdd-b37a-c92e696901b1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:06.436582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d404c422-d387-4cdd-b37a-c92e696901b1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:06.437020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d404c422-d387-4cdd-b37a-c92e696901b1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:06.663578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d404c422-d387-4cdd-b37a-c92e696901b1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:06.671541 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d404c422-d387-4cdd-b37a-c92e696901b1 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.248310 Jul 27 20:38:06.672473 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 866/1695] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:06 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:07.692922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3a7127f1-dc90-465c-b748-27d53c5fe2be tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:07.693524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3a7127f1-dc90-465c-b748-27d53c5fe2be tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:07.701015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a7127f1-dc90-465c-b748-27d53c5fe2be tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:07.701465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a7127f1-dc90-465c-b748-27d53c5fe2be tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:07.702363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a7127f1-dc90-465c-b748-27d53c5fe2be tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:07.702812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a7127f1-dc90-465c-b748-27d53c5fe2be tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:07.954069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3a7127f1-dc90-465c-b748-27d53c5fe2be tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:07.962616 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3a7127f1-dc90-465c-b748-27d53c5fe2be tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.273628 Jul 27 20:38:07.963506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 830/1696] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:07 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:08.985011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-561380c7-a2d0-40e9-a4de-f40a9a227f14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:08.985731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-561380c7-a2d0-40e9-a4de-f40a9a227f14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:08.992741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-561380c7-a2d0-40e9-a4de-f40a9a227f14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:08.993204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-561380c7-a2d0-40e9-a4de-f40a9a227f14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:08.994011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-561380c7-a2d0-40e9-a4de-f40a9a227f14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:08.994383 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-561380c7-a2d0-40e9-a4de-f40a9a227f14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:09.127615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-561380c7-a2d0-40e9-a4de-f40a9a227f14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:09.135704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-561380c7-a2d0-40e9-a4de-f40a9a227f14 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154546 Jul 27 20:38:09.136873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 867/1697] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:08 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:10.156828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-57b56e8f-5328-449e-a1ca-f3fc46f281f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:10.157374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-57b56e8f-5328-449e-a1ca-f3fc46f281f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:10.163788 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57b56e8f-5328-449e-a1ca-f3fc46f281f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:10.164238 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57b56e8f-5328-449e-a1ca-f3fc46f281f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:10.165050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57b56e8f-5328-449e-a1ca-f3fc46f281f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:10.165726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57b56e8f-5328-449e-a1ca-f3fc46f281f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:10.380632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-57b56e8f-5328-449e-a1ca-f3fc46f281f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:10.388686 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-57b56e8f-5328-449e-a1ca-f3fc46f281f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.235921 Jul 27 20:38:10.389261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 831/1698] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:10 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:11.409918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1290152b-ab2a-424d-ae6e-d03a46774282 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:11.420460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1290152b-ab2a-424d-ae6e-d03a46774282 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:11.420460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1290152b-ab2a-424d-ae6e-d03a46774282 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:11.420460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1290152b-ab2a-424d-ae6e-d03a46774282 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:11.420460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1290152b-ab2a-424d-ae6e-d03a46774282 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:11.420963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1290152b-ab2a-424d-ae6e-d03a46774282 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:11.606048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1290152b-ab2a-424d-ae6e-d03a46774282 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:11.614016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1290152b-ab2a-424d-ae6e-d03a46774282 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.207946 Jul 27 20:38:11.614582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 868/1699] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:11 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:12.635344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-420a11e5-f620-4557-b4fe-2753f7ad004c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:12.635958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-420a11e5-f620-4557-b4fe-2753f7ad004c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:12.643137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-420a11e5-f620-4557-b4fe-2753f7ad004c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:12.643942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-420a11e5-f620-4557-b4fe-2753f7ad004c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:12.645511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-420a11e5-f620-4557-b4fe-2753f7ad004c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:12.646166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-420a11e5-f620-4557-b4fe-2753f7ad004c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:12.781564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-420a11e5-f620-4557-b4fe-2753f7ad004c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:12.790535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-420a11e5-f620-4557-b4fe-2753f7ad004c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.159042 Jul 27 20:38:12.791120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 832/1700] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:12 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:13.811599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-63ec7de2-0708-4b15-89d3-8ff9452553a7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:13.812209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-63ec7de2-0708-4b15-89d3-8ff9452553a7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:13.819212 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63ec7de2-0708-4b15-89d3-8ff9452553a7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:13.819661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63ec7de2-0708-4b15-89d3-8ff9452553a7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:13.820431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63ec7de2-0708-4b15-89d3-8ff9452553a7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:13.820894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63ec7de2-0708-4b15-89d3-8ff9452553a7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:13.957633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-63ec7de2-0708-4b15-89d3-8ff9452553a7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:13.965646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-63ec7de2-0708-4b15-89d3-8ff9452553a7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.157880 Jul 27 20:38:13.966329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 869/1701] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:13 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:14.986493 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a77f9004-d3fd-4235-b496-b12c84eddab3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:14.987144 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a77f9004-d3fd-4235-b496-b12c84eddab3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:14.989078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:14.993922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a77f9004-d3fd-4235-b496-b12c84eddab3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:14.994383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a77f9004-d3fd-4235-b496-b12c84eddab3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:14.995250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a77f9004-d3fd-4235-b496-b12c84eddab3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:14.995693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a77f9004-d3fd-4235-b496-b12c84eddab3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:15.133689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a77f9004-d3fd-4235-b496-b12c84eddab3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:15.141754 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a77f9004-d3fd-4235-b496-b12c84eddab3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.159389 Jul 27 20:38:15.142324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 833/1702] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:14 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:16.164950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f6890de5-a037-416f-8428-9c6ee386b73e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:16.165629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f6890de5-a037-416f-8428-9c6ee386b73e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:16.167947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:16.172638 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6890de5-a037-416f-8428-9c6ee386b73e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:16.173086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6890de5-a037-416f-8428-9c6ee386b73e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:16.173846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6890de5-a037-416f-8428-9c6ee386b73e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:16.174272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6890de5-a037-416f-8428-9c6ee386b73e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:16.302782 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6890de5-a037-416f-8428-9c6ee386b73e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:16.310623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f6890de5-a037-416f-8428-9c6ee386b73e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149659 Jul 27 20:38:16.311201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 870/1703] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:16 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:17.333116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8e82f296-db9f-4c77-a18c-25ad11bdfb9b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:17.334630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8e82f296-db9f-4c77-a18c-25ad11bdfb9b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:17.340644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e82f296-db9f-4c77-a18c-25ad11bdfb9b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:17.341315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e82f296-db9f-4c77-a18c-25ad11bdfb9b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:17.341853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e82f296-db9f-4c77-a18c-25ad11bdfb9b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:17.342287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e82f296-db9f-4c77-a18c-25ad11bdfb9b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:17.472063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e82f296-db9f-4c77-a18c-25ad11bdfb9b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:17.480014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8e82f296-db9f-4c77-a18c-25ad11bdfb9b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151471 Jul 27 20:38:17.480613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 834/1704] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:17 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:18.500904 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9017cd74-2c4b-40c4-9a3f-1422bbf64efa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:18.501512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9017cd74-2c4b-40c4-9a3f-1422bbf64efa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:18.508576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9017cd74-2c4b-40c4-9a3f-1422bbf64efa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:18.509023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9017cd74-2c4b-40c4-9a3f-1422bbf64efa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:18.509765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9017cd74-2c4b-40c4-9a3f-1422bbf64efa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:18.510191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9017cd74-2c4b-40c4-9a3f-1422bbf64efa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:18.637137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9017cd74-2c4b-40c4-9a3f-1422bbf64efa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:18.644970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9017cd74-2c4b-40c4-9a3f-1422bbf64efa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147872 Jul 27 20:38:18.645539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 871/1705] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:18 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:19.666770 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4d841527-ac97-475a-8651-78445800eb48 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:19.667290 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4d841527-ac97-475a-8651-78445800eb48 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:19.673799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d841527-ac97-475a-8651-78445800eb48 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:19.674247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d841527-ac97-475a-8651-78445800eb48 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:19.675004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d841527-ac97-475a-8651-78445800eb48 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:19.676051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d841527-ac97-475a-8651-78445800eb48 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:19.678601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=78 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:20.009293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4d841527-ac97-475a-8651-78445800eb48 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:20.017140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4d841527-ac97-475a-8651-78445800eb48 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.354400 Jul 27 20:38:20.017704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 835/1706] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:19 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:21.039100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c83180be-3998-4ecf-8c31-e7bddc250936 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:21.039712 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c83180be-3998-4ecf-8c31-e7bddc250936 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:21.046119 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c83180be-3998-4ecf-8c31-e7bddc250936 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.046574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c83180be-3998-4ecf-8c31-e7bddc250936 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.047336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c83180be-3998-4ecf-8c31-e7bddc250936 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.047779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c83180be-3998-4ecf-8c31-e7bddc250936 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.230731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c83180be-3998-4ecf-8c31-e7bddc250936 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:21.239278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c83180be-3998-4ecf-8c31-e7bddc250936 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.204506 Jul 27 20:38:21.239855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 872/1707] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:21 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:21.630694 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2a5e6807-c044-46c9-a20b-a5d83fac30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:21.631250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2a5e6807-c044-46c9-a20b-a5d83fac30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:21.638868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a5e6807-c044-46c9-a20b-a5d83fac30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.639320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a5e6807-c044-46c9-a20b-a5d83fac30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.640098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a5e6807-c044-46c9-a20b-a5d83fac30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.640570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a5e6807-c044-46c9-a20b-a5d83fac30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.669260 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2a5e6807-c044-46c9-a20b-a5d83fac30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:38:22.036748 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2a5e6807-c044-46c9-a20b-a5d83fac30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 204 len: 0 microversion: 2.1 time: 0.409528 Jul 27 20:38:22.037345 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 836/1708] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:38:21 2022] DELETE /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:38:22.045393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9bad5703-a4e5-403b-9c8a-5f8b43fa9b4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:22.046138 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9bad5703-a4e5-403b-9c8a-5f8b43fa9b4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:22.052520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bad5703-a4e5-403b-9c8a-5f8b43fa9b4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.052968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bad5703-a4e5-403b-9c8a-5f8b43fa9b4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:22.053721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bad5703-a4e5-403b-9c8a-5f8b43fa9b4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.054149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bad5703-a4e5-403b-9c8a-5f8b43fa9b4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:22.183355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9bad5703-a4e5-403b-9c8a-5f8b43fa9b4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:22.192725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9bad5703-a4e5-403b-9c8a-5f8b43fa9b4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1719 microversion: 2.1 time: 0.151068 Jul 27 20:38:22.193294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 873/1709] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:22 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:22.261038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f5fe1239-a386-488d-bfe3-9fe674666bc0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:22.261743 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f5fe1239-a386-488d-bfe3-9fe674666bc0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:22.267729 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5fe1239-a386-488d-bfe3-9fe674666bc0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.268169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5fe1239-a386-488d-bfe3-9fe674666bc0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:22.268977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5fe1239-a386-488d-bfe3-9fe674666bc0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.269394 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5fe1239-a386-488d-bfe3-9fe674666bc0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:22.402373 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f5fe1239-a386-488d-bfe3-9fe674666bc0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:22.411332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f5fe1239-a386-488d-bfe3-9fe674666bc0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154294 Jul 27 20:38:22.411773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 837/1710] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:22 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:23.214047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-49471de5-09ba-4538-9bc9-b96e1363f984 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:23.214652 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49471de5-09ba-4538-9bc9-b96e1363f984 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:23.221488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49471de5-09ba-4538-9bc9-b96e1363f984 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:23.221936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49471de5-09ba-4538-9bc9-b96e1363f984 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:23.225199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49471de5-09ba-4538-9bc9-b96e1363f984 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:23.225199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49471de5-09ba-4538-9bc9-b96e1363f984 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:23.435549 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-db9359ae-4f50-46e8-a81a-f8ced0f317b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:23.436195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-db9359ae-4f50-46e8-a81a-f8ced0f317b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:23.444229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db9359ae-4f50-46e8-a81a-f8ced0f317b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:23.444824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db9359ae-4f50-46e8-a81a-f8ced0f317b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:23.445651 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db9359ae-4f50-46e8-a81a-f8ced0f317b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:23.446083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db9359ae-4f50-46e8-a81a-f8ced0f317b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:23.534303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49471de5-09ba-4538-9bc9-b96e1363f984 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:23.543696 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-49471de5-09ba-4538-9bc9-b96e1363f984 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1719 microversion: 2.1 time: 0.333497 Jul 27 20:38:23.544293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 874/1711] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:23 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1719 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:23.665079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-db9359ae-4f50-46e8-a81a-f8ced0f317b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:23.673157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-db9359ae-4f50-46e8-a81a-f8ced0f317b9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.241667 Jul 27 20:38:23.673828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 838/1712] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:23 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:24.236087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-76a84f6e-203a-451c-be32-1ab333b5c721 req-6c84d9b7-a62c-4da8-afef-de6b550068d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d", "name": "network-vif-deleted", "tag": "84027fbb-9bf0-449e-88d5-f3164a9148a2"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:38:24.248428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-76a84f6e-203a-451c-be32-1ab333b5c721 req-6c84d9b7-a62c-4da8-afef-de6b550068d1 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.249282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-76a84f6e-203a-451c-be32-1ab333b5c721 req-6c84d9b7-a62c-4da8-afef-de6b550068d1 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.262273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-76a84f6e-203a-451c-be32-1ab333b5c721 req-6c84d9b7-a62c-4da8-afef-de6b550068d1 service nova] Creating event network-vif-deleted:84027fbb-9bf0-449e-88d5-f3164a9148a2 for instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d on hv-cinder-85124 Jul 27 20:38:24.268538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-76a84f6e-203a-451c-be32-1ab333b5c721 req-6c84d9b7-a62c-4da8-afef-de6b550068d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115398 Jul 27 20:38:24.269865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 875/1713] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:38:24.566518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-54766ef1-b6b8-4cfa-99aa-0c4fa8b37b45 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:24.567303 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-54766ef1-b6b8-4cfa-99aa-0c4fa8b37b45 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:24.573663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54766ef1-b6b8-4cfa-99aa-0c4fa8b37b45 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.574114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54766ef1-b6b8-4cfa-99aa-0c4fa8b37b45 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.574876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54766ef1-b6b8-4cfa-99aa-0c4fa8b37b45 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.575310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54766ef1-b6b8-4cfa-99aa-0c4fa8b37b45 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.641321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-54766ef1-b6b8-4cfa-99aa-0c4fa8b37b45 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:24.649578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-54766ef1-b6b8-4cfa-99aa-0c4fa8b37b45 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.087557 Jul 27 20:38:24.650376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 839/1714] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:24 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:24.696631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-65df64ed-e5db-4f0b-8aeb-1064c68c0cb3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:24.697344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-65df64ed-e5db-4f0b-8aeb-1064c68c0cb3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:24.703623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65df64ed-e5db-4f0b-8aeb-1064c68c0cb3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.704064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65df64ed-e5db-4f0b-8aeb-1064c68c0cb3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.704914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65df64ed-e5db-4f0b-8aeb-1064c68c0cb3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.705341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65df64ed-e5db-4f0b-8aeb-1064c68c0cb3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.843092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-65df64ed-e5db-4f0b-8aeb-1064c68c0cb3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:24.852234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-65df64ed-e5db-4f0b-8aeb-1064c68c0cb3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.160198 Jul 27 20:38:24.852883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 876/1715] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:24 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:25.671392 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cf1b8243-edc2-49ab-9c3c-0616d2959013 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:25.672024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cf1b8243-edc2-49ab-9c3c-0616d2959013 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:25.679234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf1b8243-edc2-49ab-9c3c-0616d2959013 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.679687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf1b8243-edc2-49ab-9c3c-0616d2959013 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:25.680472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf1b8243-edc2-49ab-9c3c-0616d2959013 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.680912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf1b8243-edc2-49ab-9c3c-0616d2959013 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:25.742981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cf1b8243-edc2-49ab-9c3c-0616d2959013 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:25.751402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cf1b8243-edc2-49ab-9c3c-0616d2959013 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083936 Jul 27 20:38:25.751974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 840/1716] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:25 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:25.874932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-58c85fc0-2df0-40e4-ac52-bd281546f6f7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:25.875543 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-58c85fc0-2df0-40e4-ac52-bd281546f6f7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:25.881573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58c85fc0-2df0-40e4-ac52-bd281546f6f7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.882022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58c85fc0-2df0-40e4-ac52-bd281546f6f7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:25.882775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58c85fc0-2df0-40e4-ac52-bd281546f6f7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.883204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58c85fc0-2df0-40e4-ac52-bd281546f6f7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:26.012459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-58c85fc0-2df0-40e4-ac52-bd281546f6f7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:26.021501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-58c85fc0-2df0-40e4-ac52-bd281546f6f7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151232 Jul 27 20:38:26.022094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 877/1717] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:25 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:26.772741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-33e82c45-be9b-47fc-ba20-ae575da22842 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:26.773530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-33e82c45-be9b-47fc-ba20-ae575da22842 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:26.779857 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33e82c45-be9b-47fc-ba20-ae575da22842 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:26.780304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33e82c45-be9b-47fc-ba20-ae575da22842 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:26.781084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33e82c45-be9b-47fc-ba20-ae575da22842 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:26.781516 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33e82c45-be9b-47fc-ba20-ae575da22842 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:26.845934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-33e82c45-be9b-47fc-ba20-ae575da22842 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:26.854859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-33e82c45-be9b-47fc-ba20-ae575da22842 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086440 Jul 27 20:38:26.855452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 841/1718] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:26 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:27.047032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7712a07a-a95b-4351-9863-3f311e2a35bd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:27.047577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7712a07a-a95b-4351-9863-3f311e2a35bd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:27.054302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7712a07a-a95b-4351-9863-3f311e2a35bd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.054742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7712a07a-a95b-4351-9863-3f311e2a35bd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.055498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7712a07a-a95b-4351-9863-3f311e2a35bd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.055923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7712a07a-a95b-4351-9863-3f311e2a35bd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.184131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7712a07a-a95b-4351-9863-3f311e2a35bd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:27.192585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7712a07a-a95b-4351-9863-3f311e2a35bd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150405 Jul 27 20:38:27.193191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 878/1719] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:27 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:27.876509 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-84beca93-e24f-4434-b8ae-9656a2992be6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:27.877126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-84beca93-e24f-4434-b8ae-9656a2992be6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:27.883629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84beca93-e24f-4434-b8ae-9656a2992be6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.884081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84beca93-e24f-4434-b8ae-9656a2992be6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.884869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84beca93-e24f-4434-b8ae-9656a2992be6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.885313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84beca93-e24f-4434-b8ae-9656a2992be6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.946003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-84beca93-e24f-4434-b8ae-9656a2992be6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:27.953801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-84beca93-e24f-4434-b8ae-9656a2992be6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081251 Jul 27 20:38:27.954374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 842/1720] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:27 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:28.215439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f008c79f-65ee-4491-be5f-9526d89e3fe3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:28.215991 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f008c79f-65ee-4491-be5f-9526d89e3fe3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:28.222589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f008c79f-65ee-4491-be5f-9526d89e3fe3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.223151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f008c79f-65ee-4491-be5f-9526d89e3fe3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:28.224634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f008c79f-65ee-4491-be5f-9526d89e3fe3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.225233 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f008c79f-65ee-4491-be5f-9526d89e3fe3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:28.362557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f008c79f-65ee-4491-be5f-9526d89e3fe3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:28.369891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f008c79f-65ee-4491-be5f-9526d89e3fe3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.158434 Jul 27 20:38:28.370458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 879/1721] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:28 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:28.974368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-695a6225-0d75-452d-a477-a7489801f66f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:28.974954 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-695a6225-0d75-452d-a477-a7489801f66f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:28.981454 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-695a6225-0d75-452d-a477-a7489801f66f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.981902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-695a6225-0d75-452d-a477-a7489801f66f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:28.982655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-695a6225-0d75-452d-a477-a7489801f66f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.983091 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-695a6225-0d75-452d-a477-a7489801f66f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:29.045252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-695a6225-0d75-452d-a477-a7489801f66f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:29.053736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-695a6225-0d75-452d-a477-a7489801f66f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083276 Jul 27 20:38:29.054308 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 843/1722] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:28 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:29.391087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d376111f-486b-474c-84b9-e3aa53ec8450 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:29.391725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d376111f-486b-474c-84b9-e3aa53ec8450 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:29.398515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d376111f-486b-474c-84b9-e3aa53ec8450 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:29.398963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d376111f-486b-474c-84b9-e3aa53ec8450 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:29.399716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d376111f-486b-474c-84b9-e3aa53ec8450 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:29.400212 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d376111f-486b-474c-84b9-e3aa53ec8450 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:29.416293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:29.531605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d376111f-486b-474c-84b9-e3aa53ec8450 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:29.540109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d376111f-486b-474c-84b9-e3aa53ec8450 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152975 Jul 27 20:38:29.540735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 880/1723] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:29 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:30.073895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5bbe3ba0-aaa5-4606-8c90-83d9e06a4482 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:30.074510 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5bbe3ba0-aaa5-4606-8c90-83d9e06a4482 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:30.081353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5bbe3ba0-aaa5-4606-8c90-83d9e06a4482 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.082112 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5bbe3ba0-aaa5-4606-8c90-83d9e06a4482 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.082872 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5bbe3ba0-aaa5-4606-8c90-83d9e06a4482 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.083470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5bbe3ba0-aaa5-4606-8c90-83d9e06a4482 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.148732 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5bbe3ba0-aaa5-4606-8c90-83d9e06a4482 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:30.156634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5bbe3ba0-aaa5-4606-8c90-83d9e06a4482 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086578 Jul 27 20:38:30.157204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 844/1724] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:30 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:30.561902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-95d09fff-0a5d-471b-aa87-cdcbc5f558ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:30.562515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-95d09fff-0a5d-471b-aa87-cdcbc5f558ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:30.569707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95d09fff-0a5d-471b-aa87-cdcbc5f558ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.570158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95d09fff-0a5d-471b-aa87-cdcbc5f558ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.570921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95d09fff-0a5d-471b-aa87-cdcbc5f558ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.571360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95d09fff-0a5d-471b-aa87-cdcbc5f558ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.702076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-95d09fff-0a5d-471b-aa87-cdcbc5f558ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:30.710235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-95d09fff-0a5d-471b-aa87-cdcbc5f558ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152210 Jul 27 20:38:30.710818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 881/1725] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:30 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:31.177370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f1f0f406-3ded-4928-9fce-85acc9ac6c34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:31.178007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f1f0f406-3ded-4928-9fce-85acc9ac6c34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:31.185213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1f0f406-3ded-4928-9fce-85acc9ac6c34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:31.185665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1f0f406-3ded-4928-9fce-85acc9ac6c34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:31.186563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1f0f406-3ded-4928-9fce-85acc9ac6c34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:31.187004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1f0f406-3ded-4928-9fce-85acc9ac6c34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:31.251691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f1f0f406-3ded-4928-9fce-85acc9ac6c34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:31.259798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f1f0f406-3ded-4928-9fce-85acc9ac6c34 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086298 Jul 27 20:38:31.260370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 845/1726] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:31 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:31.731853 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a542a1d5-2048-43c6-bd59-53aff0580d55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:31.732501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a542a1d5-2048-43c6-bd59-53aff0580d55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:31.738882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a542a1d5-2048-43c6-bd59-53aff0580d55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:31.739325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a542a1d5-2048-43c6-bd59-53aff0580d55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:31.740064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a542a1d5-2048-43c6-bd59-53aff0580d55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:31.741170 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a542a1d5-2048-43c6-bd59-53aff0580d55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:31.871824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a542a1d5-2048-43c6-bd59-53aff0580d55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:31.882695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a542a1d5-2048-43c6-bd59-53aff0580d55 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154600 Jul 27 20:38:31.883294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 882/1727] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:31 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:32.279729 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-01cf748b-852c-44e5-bc39-99a15e7589be tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:32.280344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-01cf748b-852c-44e5-bc39-99a15e7589be tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:32.287179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-01cf748b-852c-44e5-bc39-99a15e7589be tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.287630 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-01cf748b-852c-44e5-bc39-99a15e7589be tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:32.288432 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-01cf748b-852c-44e5-bc39-99a15e7589be tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.288875 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-01cf748b-852c-44e5-bc39-99a15e7589be tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:32.349866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-01cf748b-852c-44e5-bc39-99a15e7589be tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:32.357954 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-01cf748b-852c-44e5-bc39-99a15e7589be tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081989 Jul 27 20:38:32.363911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 846/1728] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:32 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:32.905545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2063a634-61d5-4da1-89db-7c76aa151654 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:32.906156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2063a634-61d5-4da1-89db-7c76aa151654 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:32.912688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2063a634-61d5-4da1-89db-7c76aa151654 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.913144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2063a634-61d5-4da1-89db-7c76aa151654 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:32.913901 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2063a634-61d5-4da1-89db-7c76aa151654 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.914335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2063a634-61d5-4da1-89db-7c76aa151654 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:33.039878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2063a634-61d5-4da1-89db-7c76aa151654 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:33.047778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2063a634-61d5-4da1-89db-7c76aa151654 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146064 Jul 27 20:38:33.051706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 883/1729] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:32 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:33.378787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-417c25ac-3587-4992-8e15-98c757a0871a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:33.379422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-417c25ac-3587-4992-8e15-98c757a0871a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:33.385928 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-417c25ac-3587-4992-8e15-98c757a0871a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:33.386369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-417c25ac-3587-4992-8e15-98c757a0871a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:33.387116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-417c25ac-3587-4992-8e15-98c757a0871a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:33.387553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-417c25ac-3587-4992-8e15-98c757a0871a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:33.451506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-417c25ac-3587-4992-8e15-98c757a0871a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:33.460627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-417c25ac-3587-4992-8e15-98c757a0871a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085556 Jul 27 20:38:33.461187 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 847/1730] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:33 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:33.562003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:38:33.562209 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:38:34.069050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7fbf4ab6-3531-41d5-9c29-09d8439b7d95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:34.069663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7fbf4ab6-3531-41d5-9c29-09d8439b7d95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:34.076115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fbf4ab6-3531-41d5-9c29-09d8439b7d95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.077437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fbf4ab6-3531-41d5-9c29-09d8439b7d95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.078189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fbf4ab6-3531-41d5-9c29-09d8439b7d95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.078622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fbf4ab6-3531-41d5-9c29-09d8439b7d95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.209648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7fbf4ab6-3531-41d5-9c29-09d8439b7d95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:34.217860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7fbf4ab6-3531-41d5-9c29-09d8439b7d95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152616 Jul 27 20:38:34.218426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 884/1731] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:34 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:34.482013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a972fca2-d499-474a-b7cf-42e85668b7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:34.482751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a972fca2-d499-474a-b7cf-42e85668b7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:34.489300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a972fca2-d499-474a-b7cf-42e85668b7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.489751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a972fca2-d499-474a-b7cf-42e85668b7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.490552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a972fca2-d499-474a-b7cf-42e85668b7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.490986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a972fca2-d499-474a-b7cf-42e85668b7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.551299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a972fca2-d499-474a-b7cf-42e85668b7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:34.559191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a972fca2-d499-474a-b7cf-42e85668b7ca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081117 Jul 27 20:38:34.559760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 848/1732] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:34 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:35.239025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3542a8e1-936a-4ca5-827c-566de3fec6a9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:35.239648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3542a8e1-936a-4ca5-827c-566de3fec6a9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:35.247167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3542a8e1-936a-4ca5-827c-566de3fec6a9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.247677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3542a8e1-936a-4ca5-827c-566de3fec6a9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:35.248460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3542a8e1-936a-4ca5-827c-566de3fec6a9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.248892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3542a8e1-936a-4ca5-827c-566de3fec6a9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:35.379414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3542a8e1-936a-4ca5-827c-566de3fec6a9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:35.387617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3542a8e1-936a-4ca5-827c-566de3fec6a9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152664 Jul 27 20:38:35.388189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 885/1733] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:35 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:35.580305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b5c494e3-13f4-4415-9d23-f2127fc8b68e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:35.580884 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b5c494e3-13f4-4415-9d23-f2127fc8b68e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:35.587911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b5c494e3-13f4-4415-9d23-f2127fc8b68e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.588365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b5c494e3-13f4-4415-9d23-f2127fc8b68e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:35.589153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b5c494e3-13f4-4415-9d23-f2127fc8b68e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.589594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b5c494e3-13f4-4415-9d23-f2127fc8b68e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:35.649617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b5c494e3-13f4-4415-9d23-f2127fc8b68e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:35.657513 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b5c494e3-13f4-4415-9d23-f2127fc8b68e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081137 Jul 27 20:38:35.658078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 849/1734] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:35 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:36.408529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1dcfd7bd-ee23-499d-a903-834aaa601671 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:36.409137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1dcfd7bd-ee23-499d-a903-834aaa601671 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:36.415611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1dcfd7bd-ee23-499d-a903-834aaa601671 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:36.416057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1dcfd7bd-ee23-499d-a903-834aaa601671 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:36.416834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1dcfd7bd-ee23-499d-a903-834aaa601671 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:36.417269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1dcfd7bd-ee23-499d-a903-834aaa601671 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:36.541873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1dcfd7bd-ee23-499d-a903-834aaa601671 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:36.549775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1dcfd7bd-ee23-499d-a903-834aaa601671 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145212 Jul 27 20:38:36.550340 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 886/1735] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:36 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:36.679093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a923e3f4-4041-4443-8c79-684edacad585 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:36.679636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a923e3f4-4041-4443-8c79-684edacad585 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:36.686118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a923e3f4-4041-4443-8c79-684edacad585 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:36.686606 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a923e3f4-4041-4443-8c79-684edacad585 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:36.687358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a923e3f4-4041-4443-8c79-684edacad585 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:36.687790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a923e3f4-4041-4443-8c79-684edacad585 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:36.691756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:36.752063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a923e3f4-4041-4443-8c79-684edacad585 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:36.759978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a923e3f4-4041-4443-8c79-684edacad585 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085347 Jul 27 20:38:36.760570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 850/1736] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:36 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:37.571564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-937a04c6-4f5f-4a29-8a58-49c85264d0a6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:37.572166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-937a04c6-4f5f-4a29-8a58-49c85264d0a6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:37.578623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-937a04c6-4f5f-4a29-8a58-49c85264d0a6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.579063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-937a04c6-4f5f-4a29-8a58-49c85264d0a6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.581932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-937a04c6-4f5f-4a29-8a58-49c85264d0a6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.581932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-937a04c6-4f5f-4a29-8a58-49c85264d0a6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.708826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-937a04c6-4f5f-4a29-8a58-49c85264d0a6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:37.716775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-937a04c6-4f5f-4a29-8a58-49c85264d0a6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149613 Jul 27 20:38:37.717344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 887/1737] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:37 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:37.780917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3f92ff68-e1e9-47bc-9dc9-b92d9851472f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:37.781574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3f92ff68-e1e9-47bc-9dc9-b92d9851472f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:37.789203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3f92ff68-e1e9-47bc-9dc9-b92d9851472f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.789653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3f92ff68-e1e9-47bc-9dc9-b92d9851472f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.790412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3f92ff68-e1e9-47bc-9dc9-b92d9851472f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.790852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3f92ff68-e1e9-47bc-9dc9-b92d9851472f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.851646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3f92ff68-e1e9-47bc-9dc9-b92d9851472f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:37.859591 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3f92ff68-e1e9-47bc-9dc9-b92d9851472f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082935 Jul 27 20:38:37.860152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 851/1738] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:37 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:38.738347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0c0edc34-7adf-4a3a-a589-1b697280ab0f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:38.738952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0c0edc34-7adf-4a3a-a589-1b697280ab0f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:38.746166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c0edc34-7adf-4a3a-a589-1b697280ab0f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.746603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c0edc34-7adf-4a3a-a589-1b697280ab0f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.747350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c0edc34-7adf-4a3a-a589-1b697280ab0f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.747773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c0edc34-7adf-4a3a-a589-1b697280ab0f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.876802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0c0edc34-7adf-4a3a-a589-1b697280ab0f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:38.882315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1877cb23-5330-4233-bf52-670a3dd66010 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:38.882932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1877cb23-5330-4233-bf52-670a3dd66010 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:38.885435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0c0edc34-7adf-4a3a-a589-1b697280ab0f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150909 Jul 27 20:38:38.889135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 888/1739] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:38 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:38.889523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1877cb23-5330-4233-bf52-670a3dd66010 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.889982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1877cb23-5330-4233-bf52-670a3dd66010 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.890754 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1877cb23-5330-4233-bf52-670a3dd66010 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.891192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1877cb23-5330-4233-bf52-670a3dd66010 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.953847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1877cb23-5330-4233-bf52-670a3dd66010 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:38.961794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1877cb23-5330-4233-bf52-670a3dd66010 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083834 Jul 27 20:38:38.962361 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 852/1740] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:38 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:39.908399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-87f42336-3c03-479b-ab76-43fdd5e4f306 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:39.909028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-87f42336-3c03-479b-ab76-43fdd5e4f306 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:39.915613 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87f42336-3c03-479b-ab76-43fdd5e4f306 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.916057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87f42336-3c03-479b-ab76-43fdd5e4f306 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:39.916856 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87f42336-3c03-479b-ab76-43fdd5e4f306 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.917293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-87f42336-3c03-479b-ab76-43fdd5e4f306 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:39.984282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7fb17104-5b4b-41f1-a8c5-4970bf8725d6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:39.985030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7fb17104-5b4b-41f1-a8c5-4970bf8725d6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:39.992132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fb17104-5b4b-41f1-a8c5-4970bf8725d6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.992684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fb17104-5b4b-41f1-a8c5-4970bf8725d6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:39.993511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fb17104-5b4b-41f1-a8c5-4970bf8725d6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.994395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fb17104-5b4b-41f1-a8c5-4970bf8725d6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:40.069194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7fb17104-5b4b-41f1-a8c5-4970bf8725d6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:40.072643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-87f42336-3c03-479b-ab76-43fdd5e4f306 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:40.077236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7fb17104-5b4b-41f1-a8c5-4970bf8725d6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.096817 Jul 27 20:38:40.077893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 853/1741] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:39 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:40.080637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-87f42336-3c03-479b-ab76-43fdd5e4f306 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.176075 Jul 27 20:38:40.081481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 889/1742] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:39 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:40.842960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:40.843388 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:40.849376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:40.850521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:40.851302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:40.851731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:40.876643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:38:40.882640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.compute.api [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Working on deleting snapshot 436ed020-e3cc-410f-8fde-f03283c23d28 from shelved instance... Jul 27 20:38:41.098598 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-05346e57-9a86-415d-b168-9f9a833172d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:41.099178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-05346e57-9a86-415d-b168-9f9a833172d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:41.106428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05346e57-9a86-415d-b168-9f9a833172d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.106879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05346e57-9a86-415d-b168-9f9a833172d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:41.107635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05346e57-9a86-415d-b168-9f9a833172d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.108070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05346e57-9a86-415d-b168-9f9a833172d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:41.169037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-05346e57-9a86-415d-b168-9f9a833172d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:41.177057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-05346e57-9a86-415d-b168-9f9a833172d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082555 Jul 27 20:38:41.177681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 890/1743] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:41 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:41.182072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e1bb8b04-ea84-45d9-9d9e-095c6e739546 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:41.182679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e1bb8b04-ea84-45d9-9d9e-095c6e739546 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:41.188532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1bb8b04-ea84-45d9-9d9e-095c6e739546 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.188987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1bb8b04-ea84-45d9-9d9e-095c6e739546 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:41.189748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1bb8b04-ea84-45d9-9d9e-095c6e739546 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.190185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1bb8b04-ea84-45d9-9d9e-095c6e739546 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:41.323315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e1bb8b04-ea84-45d9-9d9e-095c6e739546 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:41.331394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e1bb8b04-ea84-45d9-9d9e-095c6e739546 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152735 Jul 27 20:38:41.332101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 891/1744] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:41 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:42.178297 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Doing local delete in cell deef0dc2-6aba-4ad7-810e-4420c759a7c1(cell1) {{(pid=118273) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 27 20:38:42.179092 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:42.179536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:42.179955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.compute.api [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 27 20:38:42.183560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] deallocate_for_instance() {{(pid=118273) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 27 20:38:42.199177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c781a571-ba49-46fa-b032-bc058974418b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:42.200133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c781a571-ba49-46fa-b032-bc058974418b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:42.207309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c781a571-ba49-46fa-b032-bc058974418b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:42.207759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c781a571-ba49-46fa-b032-bc058974418b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:42.208563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c781a571-ba49-46fa-b032-bc058974418b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:42.209028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c781a571-ba49-46fa-b032-bc058974418b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:42.295012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c781a571-ba49-46fa-b032-bc058974418b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:42.303453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c781a571-ba49-46fa-b032-bc058974418b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.109175 Jul 27 20:38:42.303960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 892/1745] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:42 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:42.355926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7fbad143-4bea-4031-a0f9-8b2e653d3754 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:42.356636 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7fbad143-4bea-4031-a0f9-8b2e653d3754 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:42.362592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fbad143-4bea-4031-a0f9-8b2e653d3754 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:42.363030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fbad143-4bea-4031-a0f9-8b2e653d3754 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:42.363779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fbad143-4bea-4031-a0f9-8b2e653d3754 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:42.364210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7fbad143-4bea-4031-a0f9-8b2e653d3754 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:42.570269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7fbad143-4bea-4031-a0f9-8b2e653d3754 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:42.578135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7fbad143-4bea-4031-a0f9-8b2e653d3754 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.226291 Jul 27 20:38:42.578692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 893/1746] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:42 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:43.323234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c4b7dfbe-c72b-4cad-8d96-454c98f2a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:43.323950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c4b7dfbe-c72b-4cad-8d96-454c98f2a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:43.330297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4b7dfbe-c72b-4cad-8d96-454c98f2a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:43.330758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4b7dfbe-c72b-4cad-8d96-454c98f2a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.331531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4b7dfbe-c72b-4cad-8d96-454c98f2a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:43.331970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4b7dfbe-c72b-4cad-8d96-454c98f2a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.426569 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c4b7dfbe-c72b-4cad-8d96-454c98f2a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:43.435922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c4b7dfbe-c72b-4cad-8d96-454c98f2a353 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.116613 Jul 27 20:38:43.436684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 894/1747] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:43 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:43.474348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-30be610d-948a-4db2-807f-7be564fa3903 req-2e06e342-5bd9-4a51-9044-3aeaf9763542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0929536d-2d91-4e59-8f36-474025d921ef", "name": "network-vif-deleted", "tag": "39cce058-68c6-4a18-8354-201c5dba75c7"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:38:43.487237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-30be610d-948a-4db2-807f-7be564fa3903 req-2e06e342-5bd9-4a51-9044-3aeaf9763542 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:43.487679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-30be610d-948a-4db2-807f-7be564fa3903 req-2e06e342-5bd9-4a51-9044-3aeaf9763542 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.500988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.compute.server_external_events [req-30be610d-948a-4db2-807f-7be564fa3903 req-2e06e342-5bd9-4a51-9044-3aeaf9763542 service nova] Unable to find a host for instance 0929536d-2d91-4e59-8f36-474025d921ef. Dropping event network-vif-deleted {{(pid=118274) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 20:38:43.502087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-30be610d-948a-4db2-807f-7be564fa3903 req-2e06e342-5bd9-4a51-9044-3aeaf9763542 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031710 Jul 27 20:38:43.503145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 895/1748] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 27 20:38:43.555817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Updating instance_info_cache with network_info: [] {{(pid=118273) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 27 20:38:43.600110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5b273070-716e-4e4f-84a8-65c0be0087ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:43.600662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5b273070-716e-4e4f-84a8-65c0be0087ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:43.606785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b273070-716e-4e4f-84a8-65c0be0087ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:43.607457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b273070-716e-4e4f-84a8-65c0be0087ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.608226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b273070-716e-4e4f-84a8-65c0be0087ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:43.608716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b273070-716e-4e4f-84a8-65c0be0087ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.743817 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5b273070-716e-4e4f-84a8-65c0be0087ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:43.752313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5b273070-716e-4e4f-84a8-65c0be0087ca tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.156850 Jul 27 20:38:43.752918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 896/1749] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:43 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:44.456760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f77c0a17-0a2a-483e-a0fe-3cd7941c14bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:44.457384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f77c0a17-0a2a-483e-a0fe-3cd7941c14bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:44.464973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f77c0a17-0a2a-483e-a0fe-3cd7941c14bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.465426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f77c0a17-0a2a-483e-a0fe-3cd7941c14bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.466201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f77c0a17-0a2a-483e-a0fe-3cd7941c14bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.467073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f77c0a17-0a2a-483e-a0fe-3cd7941c14bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.533695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f77c0a17-0a2a-483e-a0fe-3cd7941c14bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:44.535981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:44.542241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f77c0a17-0a2a-483e-a0fe-3cd7941c14bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.089386 Jul 27 20:38:44.542812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 897/1750] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:44 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:44.774665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f01eee53-8249-464b-b2b3-628ca2ea336b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:44.775296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f01eee53-8249-464b-b2b3-628ca2ea336b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:44.781573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f01eee53-8249-464b-b2b3-628ca2ea336b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.782014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f01eee53-8249-464b-b2b3-628ca2ea336b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.782762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f01eee53-8249-464b-b2b3-628ca2ea336b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.783189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f01eee53-8249-464b-b2b3-628ca2ea336b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.907874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f01eee53-8249-464b-b2b3-628ca2ea336b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:44.916312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f01eee53-8249-464b-b2b3-628ca2ea336b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146013 Jul 27 20:38:44.916899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 898/1751] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:44 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:45.563922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-95251dd0-f6bb-4367-b71b-58e5f600615e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:45.564578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-95251dd0-f6bb-4367-b71b-58e5f600615e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:45.571575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95251dd0-f6bb-4367-b71b-58e5f600615e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.572015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95251dd0-f6bb-4367-b71b-58e5f600615e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:45.572867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95251dd0-f6bb-4367-b71b-58e5f600615e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.573294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-95251dd0-f6bb-4367-b71b-58e5f600615e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:45.633089 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-95251dd0-f6bb-4367-b71b-58e5f600615e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:45.640835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-95251dd0-f6bb-4367-b71b-58e5f600615e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080770 Jul 27 20:38:45.641395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 899/1752] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:45 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:45.937291 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0ee09e21-4686-41fa-a834-76afe20efe54 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:45.937834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0ee09e21-4686-41fa-a834-76afe20efe54 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:45.944307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ee09e21-4686-41fa-a834-76afe20efe54 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.944790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ee09e21-4686-41fa-a834-76afe20efe54 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:45.945578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ee09e21-4686-41fa-a834-76afe20efe54 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.946011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0ee09e21-4686-41fa-a834-76afe20efe54 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:46.079447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0ee09e21-4686-41fa-a834-76afe20efe54 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:46.087925 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0ee09e21-4686-41fa-a834-76afe20efe54 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154532 Jul 27 20:38:46.088510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 900/1753] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:45 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:46.661373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-23fe761d-f1f4-41ce-9347-a9aabdc92de5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:46.661932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-23fe761d-f1f4-41ce-9347-a9aabdc92de5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:46.664282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=62 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:46.669128 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23fe761d-f1f4-41ce-9347-a9aabdc92de5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:46.669575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23fe761d-f1f4-41ce-9347-a9aabdc92de5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:46.675790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23fe761d-f1f4-41ce-9347-a9aabdc92de5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:46.675790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-23fe761d-f1f4-41ce-9347-a9aabdc92de5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:46.731817 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-23fe761d-f1f4-41ce-9347-a9aabdc92de5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:46.739833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-23fe761d-f1f4-41ce-9347-a9aabdc92de5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082350 Jul 27 20:38:46.740435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 901/1754] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:46 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:47.109592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b39bedd8-b171-488d-9f75-44f7ae49706a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:47.110203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b39bedd8-b171-488d-9f75-44f7ae49706a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:47.116642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b39bedd8-b171-488d-9f75-44f7ae49706a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:47.117093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b39bedd8-b171-488d-9f75-44f7ae49706a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:47.117842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b39bedd8-b171-488d-9f75-44f7ae49706a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:47.118272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b39bedd8-b171-488d-9f75-44f7ae49706a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:47.242799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b39bedd8-b171-488d-9f75-44f7ae49706a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:47.251057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b39bedd8-b171-488d-9f75-44f7ae49706a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145374 Jul 27 20:38:47.251626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 902/1755] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:47 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:47.760537 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5c59d3ca-48d4-41f1-81ef-b63c436e0824 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:47.761204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5c59d3ca-48d4-41f1-81ef-b63c436e0824 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:47.767592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c59d3ca-48d4-41f1-81ef-b63c436e0824 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:47.768039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c59d3ca-48d4-41f1-81ef-b63c436e0824 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:47.768832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c59d3ca-48d4-41f1-81ef-b63c436e0824 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:47.769270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c59d3ca-48d4-41f1-81ef-b63c436e0824 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:47.832962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c59d3ca-48d4-41f1-81ef-b63c436e0824 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:47.841374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5c59d3ca-48d4-41f1-81ef-b63c436e0824 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084733 Jul 27 20:38:47.841942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 903/1756] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:47 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:48.272230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9d8b4e13-7133-4752-b905-2aac0e487980 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:48.272869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9d8b4e13-7133-4752-b905-2aac0e487980 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:48.278867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d8b4e13-7133-4752-b905-2aac0e487980 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.279321 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d8b4e13-7133-4752-b905-2aac0e487980 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.280080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d8b4e13-7133-4752-b905-2aac0e487980 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.280550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d8b4e13-7133-4752-b905-2aac0e487980 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.408408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9d8b4e13-7133-4752-b905-2aac0e487980 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:48.416341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9d8b4e13-7133-4752-b905-2aac0e487980 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148640 Jul 27 20:38:48.416953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 904/1757] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:48 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:48.862560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5a8b6db5-d7f8-439c-afbb-d92757138d4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:48.863266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5a8b6db5-d7f8-439c-afbb-d92757138d4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:48.869664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a8b6db5-d7f8-439c-afbb-d92757138d4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.870121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a8b6db5-d7f8-439c-afbb-d92757138d4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.871159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a8b6db5-d7f8-439c-afbb-d92757138d4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.871599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a8b6db5-d7f8-439c-afbb-d92757138d4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.932247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a8b6db5-d7f8-439c-afbb-d92757138d4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:48.940150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5a8b6db5-d7f8-439c-afbb-d92757138d4f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081480 Jul 27 20:38:48.940751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 905/1758] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:48 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:49.437840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e8e7148-4196-4574-8f91-80e713f20a00 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:49.438367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7e8e7148-4196-4574-8f91-80e713f20a00 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:49.445001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e8e7148-4196-4574-8f91-80e713f20a00 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:49.445457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e8e7148-4196-4574-8f91-80e713f20a00 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:49.446217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e8e7148-4196-4574-8f91-80e713f20a00 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:49.446650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e8e7148-4196-4574-8f91-80e713f20a00 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:49.579239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7e8e7148-4196-4574-8f91-80e713f20a00 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:49.587121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7e8e7148-4196-4574-8f91-80e713f20a00 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153244 Jul 27 20:38:49.587694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 906/1759] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:49 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:49.961157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-822b1bc6-2fbc-48da-9ecc-87804eb218a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:49.961833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-822b1bc6-2fbc-48da-9ecc-87804eb218a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:49.968401 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-822b1bc6-2fbc-48da-9ecc-87804eb218a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:49.968873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-822b1bc6-2fbc-48da-9ecc-87804eb218a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:49.969637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-822b1bc6-2fbc-48da-9ecc-87804eb218a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:49.970072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-822b1bc6-2fbc-48da-9ecc-87804eb218a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:50.034716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-822b1bc6-2fbc-48da-9ecc-87804eb218a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:50.042742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-822b1bc6-2fbc-48da-9ecc-87804eb218a8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085398 Jul 27 20:38:50.043320 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 907/1760] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:49 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:50.608782 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2902809c-dd8e-4a00-99c3-14610f731553 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:50.609360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2902809c-dd8e-4a00-99c3-14610f731553 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:50.615800 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2902809c-dd8e-4a00-99c3-14610f731553 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:50.616249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2902809c-dd8e-4a00-99c3-14610f731553 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:50.617027 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2902809c-dd8e-4a00-99c3-14610f731553 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:50.617461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2902809c-dd8e-4a00-99c3-14610f731553 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:50.741944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2902809c-dd8e-4a00-99c3-14610f731553 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:50.750036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2902809c-dd8e-4a00-99c3-14610f731553 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145263 Jul 27 20:38:50.750611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 908/1761] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:50 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:51.063081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a28c4152-6775-439d-866e-7b195e194ddf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:51.063731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a28c4152-6775-439d-866e-7b195e194ddf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:51.070136 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a28c4152-6775-439d-866e-7b195e194ddf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.070584 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a28c4152-6775-439d-866e-7b195e194ddf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.071342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a28c4152-6775-439d-866e-7b195e194ddf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.071774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a28c4152-6775-439d-866e-7b195e194ddf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.137782 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a28c4152-6775-439d-866e-7b195e194ddf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:51.145850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a28c4152-6775-439d-866e-7b195e194ddf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086612 Jul 27 20:38:51.146421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 909/1762] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:51 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:51.772285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eb82b882-3821-4fb4-adac-7e9e8da02612 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:51.772926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eb82b882-3821-4fb4-adac-7e9e8da02612 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:51.779164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb82b882-3821-4fb4-adac-7e9e8da02612 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.779635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb82b882-3821-4fb4-adac-7e9e8da02612 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.780406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb82b882-3821-4fb4-adac-7e9e8da02612 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.780846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb82b882-3821-4fb4-adac-7e9e8da02612 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.908780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eb82b882-3821-4fb4-adac-7e9e8da02612 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:51.917870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eb82b882-3821-4fb4-adac-7e9e8da02612 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149784 Jul 27 20:38:51.918465 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 910/1763] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:51 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:52.166289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-16173aea-2e7a-485b-a2ee-bf33fb2c003c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:52.166973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-16173aea-2e7a-485b-a2ee-bf33fb2c003c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:52.173284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-16173aea-2e7a-485b-a2ee-bf33fb2c003c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:52.173725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-16173aea-2e7a-485b-a2ee-bf33fb2c003c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:52.174468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-16173aea-2e7a-485b-a2ee-bf33fb2c003c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:52.175129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-16173aea-2e7a-485b-a2ee-bf33fb2c003c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:52.175324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:52.236570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-16173aea-2e7a-485b-a2ee-bf33fb2c003c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:52.244883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-16173aea-2e7a-485b-a2ee-bf33fb2c003c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082446 Jul 27 20:38:52.245444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 911/1764] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:52 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:52.938905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0697f8d7-6b3b-4ad0-a678-9607f6f3b396 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:52.939512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0697f8d7-6b3b-4ad0-a678-9607f6f3b396 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:52.945713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0697f8d7-6b3b-4ad0-a678-9607f6f3b396 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:52.946168 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0697f8d7-6b3b-4ad0-a678-9607f6f3b396 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:52.946934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0697f8d7-6b3b-4ad0-a678-9607f6f3b396 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:52.947370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0697f8d7-6b3b-4ad0-a678-9607f6f3b396 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:53.078206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0697f8d7-6b3b-4ad0-a678-9607f6f3b396 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:53.086169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0697f8d7-6b3b-4ad0-a678-9607f6f3b396 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151155 Jul 27 20:38:53.086745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 912/1765] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:52 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:53.266521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-56e2c224-bbaa-4f77-bb49-9cc813d87bc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:53.267171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-56e2c224-bbaa-4f77-bb49-9cc813d87bc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:53.273553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-56e2c224-bbaa-4f77-bb49-9cc813d87bc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:53.273993 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-56e2c224-bbaa-4f77-bb49-9cc813d87bc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:53.274745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-56e2c224-bbaa-4f77-bb49-9cc813d87bc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:53.275171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-56e2c224-bbaa-4f77-bb49-9cc813d87bc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:53.336131 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-56e2c224-bbaa-4f77-bb49-9cc813d87bc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:53.344768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-56e2c224-bbaa-4f77-bb49-9cc813d87bc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082086 Jul 27 20:38:53.345338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 913/1766] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:53 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:53.657973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:54.108563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ffe35fc6-9496-479a-853e-c46ea49a8889 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:54.109188 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ffe35fc6-9496-479a-853e-c46ea49a8889 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:54.115379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ffe35fc6-9496-479a-853e-c46ea49a8889 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:54.115830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ffe35fc6-9496-479a-853e-c46ea49a8889 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:54.116615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ffe35fc6-9496-479a-853e-c46ea49a8889 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:54.117052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ffe35fc6-9496-479a-853e-c46ea49a8889 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:54.132417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:54.246606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ffe35fc6-9496-479a-853e-c46ea49a8889 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:54.252827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ffe35fc6-9496-479a-853e-c46ea49a8889 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148155 Jul 27 20:38:54.253403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 914/1767] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:54 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:54.366439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2bd5033c-2bd9-42fb-8ff3-95e1b0aead3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:54.367009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2bd5033c-2bd9-42fb-8ff3-95e1b0aead3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:54.373780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bd5033c-2bd9-42fb-8ff3-95e1b0aead3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:54.374227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bd5033c-2bd9-42fb-8ff3-95e1b0aead3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:54.374978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bd5033c-2bd9-42fb-8ff3-95e1b0aead3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:54.375409 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2bd5033c-2bd9-42fb-8ff3-95e1b0aead3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:54.438822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2bd5033c-2bd9-42fb-8ff3-95e1b0aead3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:54.447323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2bd5033c-2bd9-42fb-8ff3-95e1b0aead3a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085338 Jul 27 20:38:54.447894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 915/1768] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:54 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:55.274108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e7e491cc-a409-4839-aad8-5781a357e196 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:55.278375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e7e491cc-a409-4839-aad8-5781a357e196 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:55.280922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e7e491cc-a409-4839-aad8-5781a357e196 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.281364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e7e491cc-a409-4839-aad8-5781a357e196 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:55.282115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e7e491cc-a409-4839-aad8-5781a357e196 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.282545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e7e491cc-a409-4839-aad8-5781a357e196 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:55.411751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e7e491cc-a409-4839-aad8-5781a357e196 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:55.419782 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e7e491cc-a409-4839-aad8-5781a357e196 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149603 Jul 27 20:38:55.420353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 916/1769] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:55 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:55.466779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3799cfde-4196-4c36-9394-5970fb860eed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:55.467379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3799cfde-4196-4c36-9394-5970fb860eed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:55.473319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3799cfde-4196-4c36-9394-5970fb860eed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.474313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3799cfde-4196-4c36-9394-5970fb860eed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:55.475206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3799cfde-4196-4c36-9394-5970fb860eed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.475638 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3799cfde-4196-4c36-9394-5970fb860eed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:55.535616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3799cfde-4196-4c36-9394-5970fb860eed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:55.543779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3799cfde-4196-4c36-9394-5970fb860eed tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080691 Jul 27 20:38:55.544338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 917/1770] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:55 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:56.442617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bc9b8554-93a2-446f-b151-b071eb8bf7eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:56.443256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bc9b8554-93a2-446f-b151-b071eb8bf7eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:56.449766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc9b8554-93a2-446f-b151-b071eb8bf7eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:56.450220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc9b8554-93a2-446f-b151-b071eb8bf7eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:56.450977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc9b8554-93a2-446f-b151-b071eb8bf7eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:56.451415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc9b8554-93a2-446f-b151-b071eb8bf7eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:56.579081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bc9b8554-93a2-446f-b151-b071eb8bf7eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:56.587404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bc9b8554-93a2-446f-b151-b071eb8bf7eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148745 Jul 27 20:38:56.587967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 918/1771] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:56 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:56.592312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f9a151e5-aec8-4b2b-a8ab-c211554f1ff8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:56.592879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f9a151e5-aec8-4b2b-a8ab-c211554f1ff8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:56.598342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9a151e5-aec8-4b2b-a8ab-c211554f1ff8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:56.598793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9a151e5-aec8-4b2b-a8ab-c211554f1ff8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:56.600243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9a151e5-aec8-4b2b-a8ab-c211554f1ff8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:56.600707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9a151e5-aec8-4b2b-a8ab-c211554f1ff8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:56.659668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f9a151e5-aec8-4b2b-a8ab-c211554f1ff8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:56.668058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f9a151e5-aec8-4b2b-a8ab-c211554f1ff8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.079133 Jul 27 20:38:56.668656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 919/1772] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:56 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:57.609277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-78833f6e-b92f-424a-8db3-70e4e6837503 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:57.609919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-78833f6e-b92f-424a-8db3-70e4e6837503 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:57.616987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-78833f6e-b92f-424a-8db3-70e4e6837503 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.617438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-78833f6e-b92f-424a-8db3-70e4e6837503 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.618197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-78833f6e-b92f-424a-8db3-70e4e6837503 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.618631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-78833f6e-b92f-424a-8db3-70e4e6837503 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.746822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-78833f6e-b92f-424a-8db3-70e4e6837503 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:57.754619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-78833f6e-b92f-424a-8db3-70e4e6837503 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149296 Jul 27 20:38:57.755221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 920/1773] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:57 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:57.759531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-372a571d-0198-4f56-a7d7-61974f4d4530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:57.760123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-372a571d-0198-4f56-a7d7-61974f4d4530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:57.765620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-372a571d-0198-4f56-a7d7-61974f4d4530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.766053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-372a571d-0198-4f56-a7d7-61974f4d4530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.766799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-372a571d-0198-4f56-a7d7-61974f4d4530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.767222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-372a571d-0198-4f56-a7d7-61974f4d4530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.829620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-372a571d-0198-4f56-a7d7-61974f4d4530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:57.837481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-372a571d-0198-4f56-a7d7-61974f4d4530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081322 Jul 27 20:38:57.838041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 921/1774] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:57 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:58.776074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-825e41af-1e05-4cc9-aad1-1a58387f758a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:58.776787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-825e41af-1e05-4cc9-aad1-1a58387f758a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:58.783114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-825e41af-1e05-4cc9-aad1-1a58387f758a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.783553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-825e41af-1e05-4cc9-aad1-1a58387f758a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.784296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-825e41af-1e05-4cc9-aad1-1a58387f758a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.784818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-825e41af-1e05-4cc9-aad1-1a58387f758a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.910569 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-825e41af-1e05-4cc9-aad1-1a58387f758a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:58.919038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-825e41af-1e05-4cc9-aad1-1a58387f758a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146826 Jul 27 20:38:58.919603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 922/1775] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:58 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:58.924058 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5a9026e5-1473-43af-bd5d-2a74d42537b6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:58.924677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5a9026e5-1473-43af-bd5d-2a74d42537b6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:58.930126 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a9026e5-1473-43af-bd5d-2a74d42537b6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.930575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a9026e5-1473-43af-bd5d-2a74d42537b6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.931356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a9026e5-1473-43af-bd5d-2a74d42537b6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.931792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a9026e5-1473-43af-bd5d-2a74d42537b6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.991097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a9026e5-1473-43af-bd5d-2a74d42537b6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:58.999156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5a9026e5-1473-43af-bd5d-2a74d42537b6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.078635 Jul 27 20:38:58.999722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 923/1776] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:58 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:59.940206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f69299c6-9e98-49ce-8b7b-fd23ca832e43 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:59.940917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f69299c6-9e98-49ce-8b7b-fd23ca832e43 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:59.947310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f69299c6-9e98-49ce-8b7b-fd23ca832e43 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:59.947765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f69299c6-9e98-49ce-8b7b-fd23ca832e43 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:59.948559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f69299c6-9e98-49ce-8b7b-fd23ca832e43 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:59.948996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f69299c6-9e98-49ce-8b7b-fd23ca832e43 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:00.077962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f69299c6-9e98-49ce-8b7b-fd23ca832e43 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:00.086614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f69299c6-9e98-49ce-8b7b-fd23ca832e43 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150320 Jul 27 20:39:00.087189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 924/1777] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:59 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:00.091601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f1430cfe-5674-40d1-a7c8-34aac00cf519 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:00.092206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f1430cfe-5674-40d1-a7c8-34aac00cf519 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:00.097799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1430cfe-5674-40d1-a7c8-34aac00cf519 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:00.098254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1430cfe-5674-40d1-a7c8-34aac00cf519 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:00.099022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1430cfe-5674-40d1-a7c8-34aac00cf519 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:00.099448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1430cfe-5674-40d1-a7c8-34aac00cf519 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:00.158939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f1430cfe-5674-40d1-a7c8-34aac00cf519 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:00.166949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f1430cfe-5674-40d1-a7c8-34aac00cf519 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.078827 Jul 27 20:39:00.167517 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 925/1778] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:00 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:01.107756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4354dbc7-d07d-48e4-883a-03a59bc830ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:01.108454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4354dbc7-d07d-48e4-883a-03a59bc830ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:01.114823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4354dbc7-d07d-48e4-883a-03a59bc830ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:01.115270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4354dbc7-d07d-48e4-883a-03a59bc830ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:01.116022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4354dbc7-d07d-48e4-883a-03a59bc830ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:01.116483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4354dbc7-d07d-48e4-883a-03a59bc830ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:01.243736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4354dbc7-d07d-48e4-883a-03a59bc830ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:01.251784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4354dbc7-d07d-48e4-883a-03a59bc830ee tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147919 Jul 27 20:39:01.252360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 926/1779] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:01 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:01.256717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-05e07f26-59eb-47a8-949a-582ea567f31a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:01.257309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-05e07f26-59eb-47a8-949a-582ea567f31a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:01.262970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05e07f26-59eb-47a8-949a-582ea567f31a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:01.263426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05e07f26-59eb-47a8-949a-582ea567f31a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:01.264193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05e07f26-59eb-47a8-949a-582ea567f31a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:01.264666 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-05e07f26-59eb-47a8-949a-582ea567f31a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:01.327996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-05e07f26-59eb-47a8-949a-582ea567f31a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:01.336643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-05e07f26-59eb-47a8-949a-582ea567f31a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083210 Jul 27 20:39:01.337351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 927/1780] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:01 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:02.273680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1660c050-6726-418d-ab6e-34684093080c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:02.274357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1660c050-6726-418d-ab6e-34684093080c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:02.280698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1660c050-6726-418d-ab6e-34684093080c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.281149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1660c050-6726-418d-ab6e-34684093080c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:02.281906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1660c050-6726-418d-ab6e-34684093080c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.282338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1660c050-6726-418d-ab6e-34684093080c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:02.411778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1660c050-6726-418d-ab6e-34684093080c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:02.419729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1660c050-6726-418d-ab6e-34684093080c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150564 Jul 27 20:39:02.420296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 928/1781] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:02 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:02.424727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-32975177-e2f8-4d52-aff1-5d6db75f44ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:02.425369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-32975177-e2f8-4d52-aff1-5d6db75f44ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:02.431343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32975177-e2f8-4d52-aff1-5d6db75f44ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.431798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32975177-e2f8-4d52-aff1-5d6db75f44ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:02.432785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32975177-e2f8-4d52-aff1-5d6db75f44ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.433779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32975177-e2f8-4d52-aff1-5d6db75f44ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:02.493675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-32975177-e2f8-4d52-aff1-5d6db75f44ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:02.501863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-32975177-e2f8-4d52-aff1-5d6db75f44ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080580 Jul 27 20:39:02.502430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 929/1782] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:02 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:03.444671 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-68f62142-54a0-402c-ac83-e2f43ea249b6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:03.445283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-68f62142-54a0-402c-ac83-e2f43ea249b6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:03.451762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68f62142-54a0-402c-ac83-e2f43ea249b6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:03.452223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68f62142-54a0-402c-ac83-e2f43ea249b6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:03.453014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68f62142-54a0-402c-ac83-e2f43ea249b6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:03.453449 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68f62142-54a0-402c-ac83-e2f43ea249b6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:03.584539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-68f62142-54a0-402c-ac83-e2f43ea249b6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:03.592453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-68f62142-54a0-402c-ac83-e2f43ea249b6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152194 Jul 27 20:39:03.592971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 930/1783] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:03 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:03.597417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1666b77e-0f6e-49ff-9adb-69467f10f4da tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:03.598016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1666b77e-0f6e-49ff-9adb-69467f10f4da tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:03.603448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1666b77e-0f6e-49ff-9adb-69467f10f4da tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:03.603892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1666b77e-0f6e-49ff-9adb-69467f10f4da tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:03.604679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1666b77e-0f6e-49ff-9adb-69467f10f4da tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:03.605112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1666b77e-0f6e-49ff-9adb-69467f10f4da tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:03.608937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:03.665888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1666b77e-0f6e-49ff-9adb-69467f10f4da tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:03.673740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1666b77e-0f6e-49ff-9adb-69467f10f4da tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.079843 Jul 27 20:39:03.674302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 931/1784] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:03 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:04.613389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c48d5878-a2be-4dd8-a294-b61db78eb32c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:04.614014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c48d5878-a2be-4dd8-a294-b61db78eb32c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:04.620416 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c48d5878-a2be-4dd8-a294-b61db78eb32c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.621119 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c48d5878-a2be-4dd8-a294-b61db78eb32c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.621870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c48d5878-a2be-4dd8-a294-b61db78eb32c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.622301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c48d5878-a2be-4dd8-a294-b61db78eb32c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.749202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c48d5878-a2be-4dd8-a294-b61db78eb32c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:04.757656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c48d5878-a2be-4dd8-a294-b61db78eb32c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148166 Jul 27 20:39:04.758228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 932/1785] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:04 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:04.762575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4e39f6aa-3f21-4722-a3a2-cd4a6aebd290 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:04.763177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4e39f6aa-3f21-4722-a3a2-cd4a6aebd290 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:04.768746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e39f6aa-3f21-4722-a3a2-cd4a6aebd290 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.769198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e39f6aa-3f21-4722-a3a2-cd4a6aebd290 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.769959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e39f6aa-3f21-4722-a3a2-cd4a6aebd290 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.771028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e39f6aa-3f21-4722-a3a2-cd4a6aebd290 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.834398 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4e39f6aa-3f21-4722-a3a2-cd4a6aebd290 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:04.842312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4e39f6aa-3f21-4722-a3a2-cd4a6aebd290 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083154 Jul 27 20:39:04.842888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 933/1786] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:04 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:05.779889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a6991fd5-ee05-45ee-9223-8139a07adaf8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:05.780587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a6991fd5-ee05-45ee-9223-8139a07adaf8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:05.786930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6991fd5-ee05-45ee-9223-8139a07adaf8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.787367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6991fd5-ee05-45ee-9223-8139a07adaf8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.788113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6991fd5-ee05-45ee-9223-8139a07adaf8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.788573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6991fd5-ee05-45ee-9223-8139a07adaf8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.914191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a6991fd5-ee05-45ee-9223-8139a07adaf8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:05.922048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a6991fd5-ee05-45ee-9223-8139a07adaf8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146022 Jul 27 20:39:05.922621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 934/1787] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:05 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:05.927410 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6981da55-ae01-48e1-bc9f-b1d2439dd12b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:05.928009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6981da55-ae01-48e1-bc9f-b1d2439dd12b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:05.933539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6981da55-ae01-48e1-bc9f-b1d2439dd12b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.933984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6981da55-ae01-48e1-bc9f-b1d2439dd12b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.934735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6981da55-ae01-48e1-bc9f-b1d2439dd12b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.935162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6981da55-ae01-48e1-bc9f-b1d2439dd12b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.997121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6981da55-ae01-48e1-bc9f-b1d2439dd12b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:06.004921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6981da55-ae01-48e1-bc9f-b1d2439dd12b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081371 Jul 27 20:39:06.005485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 935/1788] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:05 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:06.943913 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6e3b234a-3840-4d02-8443-bd2489312bc7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:06.944606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6e3b234a-3840-4d02-8443-bd2489312bc7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:06.951193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e3b234a-3840-4d02-8443-bd2489312bc7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:06.951646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e3b234a-3840-4d02-8443-bd2489312bc7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:06.952406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e3b234a-3840-4d02-8443-bd2489312bc7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:06.952845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e3b234a-3840-4d02-8443-bd2489312bc7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:07.081583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6e3b234a-3840-4d02-8443-bd2489312bc7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:07.090116 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6e3b234a-3840-4d02-8443-bd2489312bc7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150575 Jul 27 20:39:07.090699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 936/1789] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:06 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:07.095150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8a6354ad-44e6-47bd-96c6-72d97fbc49d9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:07.095750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8a6354ad-44e6-47bd-96c6-72d97fbc49d9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:07.101350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a6354ad-44e6-47bd-96c6-72d97fbc49d9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:07.101795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a6354ad-44e6-47bd-96c6-72d97fbc49d9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:07.102545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a6354ad-44e6-47bd-96c6-72d97fbc49d9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:07.102974 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a6354ad-44e6-47bd-96c6-72d97fbc49d9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:07.162345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8a6354ad-44e6-47bd-96c6-72d97fbc49d9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:07.170173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8a6354ad-44e6-47bd-96c6-72d97fbc49d9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.078548 Jul 27 20:39:07.170742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 937/1790] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:07 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:08.111150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d0fffaca-3a3c-4b55-90b0-23e3fc96872d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:08.111860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d0fffaca-3a3c-4b55-90b0-23e3fc96872d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:08.118713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0fffaca-3a3c-4b55-90b0-23e3fc96872d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:08.119151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0fffaca-3a3c-4b55-90b0-23e3fc96872d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:08.119901 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0fffaca-3a3c-4b55-90b0-23e3fc96872d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:08.120327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d0fffaca-3a3c-4b55-90b0-23e3fc96872d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:08.249526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d0fffaca-3a3c-4b55-90b0-23e3fc96872d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:08.257433 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d0fffaca-3a3c-4b55-90b0-23e3fc96872d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150211 Jul 27 20:39:08.257999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 938/1791] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:08 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:08.262333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c591639c-1bd2-4718-905c-c52c721c3144 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:08.262928 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c591639c-1bd2-4718-905c-c52c721c3144 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:08.269055 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c591639c-1bd2-4718-905c-c52c721c3144 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:08.269511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c591639c-1bd2-4718-905c-c52c721c3144 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:08.270314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c591639c-1bd2-4718-905c-c52c721c3144 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:08.270779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c591639c-1bd2-4718-905c-c52c721c3144 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:08.334737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c591639c-1bd2-4718-905c-c52c721c3144 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:08.342734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c591639c-1bd2-4718-905c-c52c721c3144 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083807 Jul 27 20:39:08.343296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 939/1792] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:08 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:09.279045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-69018cdb-0e78-4fe0-b037-60ddef606ed4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:09.279713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-69018cdb-0e78-4fe0-b037-60ddef606ed4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:09.286240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-69018cdb-0e78-4fe0-b037-60ddef606ed4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:09.286686 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-69018cdb-0e78-4fe0-b037-60ddef606ed4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:09.287434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-69018cdb-0e78-4fe0-b037-60ddef606ed4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:09.287865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-69018cdb-0e78-4fe0-b037-60ddef606ed4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:09.416237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-69018cdb-0e78-4fe0-b037-60ddef606ed4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:09.424108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-69018cdb-0e78-4fe0-b037-60ddef606ed4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148895 Jul 27 20:39:09.424708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 940/1793] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:09 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:09.429752 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a219acc8-0880-4b2a-a1a5-c999c8204d17 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:09.430352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a219acc8-0880-4b2a-a1a5-c999c8204d17 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:09.435833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a219acc8-0880-4b2a-a1a5-c999c8204d17 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:09.436281 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a219acc8-0880-4b2a-a1a5-c999c8204d17 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:09.437066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a219acc8-0880-4b2a-a1a5-c999c8204d17 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:09.437500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a219acc8-0880-4b2a-a1a5-c999c8204d17 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:09.498026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a219acc8-0880-4b2a-a1a5-c999c8204d17 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:09.506663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a219acc8-0880-4b2a-a1a5-c999c8204d17 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081034 Jul 27 20:39:09.507238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 941/1794] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:09 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:10.445676 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-50461de0-aae2-47e7-9a42-121bb6e58b7f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:10.446325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-50461de0-aae2-47e7-9a42-121bb6e58b7f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:10.452876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-50461de0-aae2-47e7-9a42-121bb6e58b7f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.453324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-50461de0-aae2-47e7-9a42-121bb6e58b7f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.454080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-50461de0-aae2-47e7-9a42-121bb6e58b7f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.454516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-50461de0-aae2-47e7-9a42-121bb6e58b7f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.587051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-50461de0-aae2-47e7-9a42-121bb6e58b7f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:10.595070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-50461de0-aae2-47e7-9a42-121bb6e58b7f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153240 Jul 27 20:39:10.595587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 942/1795] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:10 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:10.599907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c8020963-304a-4efc-b98c-6702ba1539c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:10.600539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c8020963-304a-4efc-b98c-6702ba1539c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:10.606253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8020963-304a-4efc-b98c-6702ba1539c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.606708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8020963-304a-4efc-b98c-6702ba1539c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.607508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8020963-304a-4efc-b98c-6702ba1539c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.607946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8020963-304a-4efc-b98c-6702ba1539c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.669528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c8020963-304a-4efc-b98c-6702ba1539c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:10.677453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c8020963-304a-4efc-b98c-6702ba1539c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080945 Jul 27 20:39:10.678026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 943/1796] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:10 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:11.615698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-800593d3-2f5b-45b5-9e6a-6b849b7ea300 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:11.616348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-800593d3-2f5b-45b5-9e6a-6b849b7ea300 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:11.623098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-800593d3-2f5b-45b5-9e6a-6b849b7ea300 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.623547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-800593d3-2f5b-45b5-9e6a-6b849b7ea300 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.624304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-800593d3-2f5b-45b5-9e6a-6b849b7ea300 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.624764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-800593d3-2f5b-45b5-9e6a-6b849b7ea300 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.748974 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-800593d3-2f5b-45b5-9e6a-6b849b7ea300 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:11.757664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-800593d3-2f5b-45b5-9e6a-6b849b7ea300 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146371 Jul 27 20:39:11.758240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 944/1797] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:11 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:11.762778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-258663af-d8ea-4c5a-aac0-879cdab58b86 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:11.763379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-258663af-d8ea-4c5a-aac0-879cdab58b86 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:11.768944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-258663af-d8ea-4c5a-aac0-879cdab58b86 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.769395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-258663af-d8ea-4c5a-aac0-879cdab58b86 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.770151 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-258663af-d8ea-4c5a-aac0-879cdab58b86 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.770582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-258663af-d8ea-4c5a-aac0-879cdab58b86 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.832983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-258663af-d8ea-4c5a-aac0-879cdab58b86 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:11.840849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-258663af-d8ea-4c5a-aac0-879cdab58b86 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081671 Jul 27 20:39:11.841421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 945/1798] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:11 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:12.778331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cc7b221a-bddb-4654-a06e-f995d1d85ac6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:12.778968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cc7b221a-bddb-4654-a06e-f995d1d85ac6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:12.785413 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc7b221a-bddb-4654-a06e-f995d1d85ac6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.785851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc7b221a-bddb-4654-a06e-f995d1d85ac6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.786594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc7b221a-bddb-4654-a06e-f995d1d85ac6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.787019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc7b221a-bddb-4654-a06e-f995d1d85ac6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.913785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cc7b221a-bddb-4654-a06e-f995d1d85ac6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:12.921677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cc7b221a-bddb-4654-a06e-f995d1d85ac6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147158 Jul 27 20:39:12.922244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 946/1799] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:12 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:12.926663 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e95a0869-8aca-4bcd-abb1-b57900c65869 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:12.927268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e95a0869-8aca-4bcd-abb1-b57900c65869 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:12.932820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e95a0869-8aca-4bcd-abb1-b57900c65869 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.933274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e95a0869-8aca-4bcd-abb1-b57900c65869 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.934032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e95a0869-8aca-4bcd-abb1-b57900c65869 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.934470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e95a0869-8aca-4bcd-abb1-b57900c65869 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.993990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e95a0869-8aca-4bcd-abb1-b57900c65869 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:12.996409 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:13.002639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e95a0869-8aca-4bcd-abb1-b57900c65869 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.079435 Jul 27 20:39:13.003226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 947/1800] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:12 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:13.943546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-323f0864-d747-42e4-aae4-9d7a31e0c25c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:13.944247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-323f0864-d747-42e4-aae4-9d7a31e0c25c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:13.951103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-323f0864-d747-42e4-aae4-9d7a31e0c25c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:13.951557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-323f0864-d747-42e4-aae4-9d7a31e0c25c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:13.952313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-323f0864-d747-42e4-aae4-9d7a31e0c25c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:13.952777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-323f0864-d747-42e4-aae4-9d7a31e0c25c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:14.083402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-323f0864-d747-42e4-aae4-9d7a31e0c25c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:14.091457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-323f0864-d747-42e4-aae4-9d7a31e0c25c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152506 Jul 27 20:39:14.092032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 948/1801] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:13 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:14.096502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-deeefa75-4f92-4af9-ac8c-0ac9b2b4d3b5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:14.097118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-deeefa75-4f92-4af9-ac8c-0ac9b2b4d3b5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:14.103118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deeefa75-4f92-4af9-ac8c-0ac9b2b4d3b5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:14.108241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deeefa75-4f92-4af9-ac8c-0ac9b2b4d3b5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:14.108241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deeefa75-4f92-4af9-ac8c-0ac9b2b4d3b5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:14.108241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-deeefa75-4f92-4af9-ac8c-0ac9b2b4d3b5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:14.166099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-deeefa75-4f92-4af9-ac8c-0ac9b2b4d3b5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:14.173990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-deeefa75-4f92-4af9-ac8c-0ac9b2b4d3b5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080994 Jul 27 20:39:14.174565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 949/1802] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:14 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:15.111854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9ee4cddc-e963-4f83-8719-9139eabc1e24 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:15.112555 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9ee4cddc-e963-4f83-8719-9139eabc1e24 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:15.119590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ee4cddc-e963-4f83-8719-9139eabc1e24 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.120034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ee4cddc-e963-4f83-8719-9139eabc1e24 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.121068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ee4cddc-e963-4f83-8719-9139eabc1e24 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.121498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ee4cddc-e963-4f83-8719-9139eabc1e24 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.250897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9ee4cddc-e963-4f83-8719-9139eabc1e24 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:15.258932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9ee4cddc-e963-4f83-8719-9139eabc1e24 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150965 Jul 27 20:39:15.259756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 950/1803] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:15 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:15.264167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4e460fda-a622-4391-8fd5-ea62ddcc02f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:15.264800 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4e460fda-a622-4391-8fd5-ea62ddcc02f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:15.266420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:15.271071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e460fda-a622-4391-8fd5-ea62ddcc02f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.274392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e460fda-a622-4391-8fd5-ea62ddcc02f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.274392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e460fda-a622-4391-8fd5-ea62ddcc02f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.274392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e460fda-a622-4391-8fd5-ea62ddcc02f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.338721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4e460fda-a622-4391-8fd5-ea62ddcc02f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:15.347019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4e460fda-a622-4391-8fd5-ea62ddcc02f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086325 Jul 27 20:39:15.347589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 951/1804] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:15 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:16.280686 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-71db5261-ff13-417f-9c51-f4bd46bd93cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:16.281360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-71db5261-ff13-417f-9c51-f4bd46bd93cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:16.287767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71db5261-ff13-417f-9c51-f4bd46bd93cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:16.288370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71db5261-ff13-417f-9c51-f4bd46bd93cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:16.289149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71db5261-ff13-417f-9c51-f4bd46bd93cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:16.289574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71db5261-ff13-417f-9c51-f4bd46bd93cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:16.416981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-71db5261-ff13-417f-9c51-f4bd46bd93cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:16.425125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-71db5261-ff13-417f-9c51-f4bd46bd93cb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148829 Jul 27 20:39:16.425688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 952/1805] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:16 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:16.430776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8e59c430-1c2a-455e-94d0-c376cdf79f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:16.431455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8e59c430-1c2a-455e-94d0-c376cdf79f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:16.437501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e59c430-1c2a-455e-94d0-c376cdf79f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:16.437942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e59c430-1c2a-455e-94d0-c376cdf79f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:16.438689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e59c430-1c2a-455e-94d0-c376cdf79f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:16.439114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e59c430-1c2a-455e-94d0-c376cdf79f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:16.501595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e59c430-1c2a-455e-94d0-c376cdf79f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:16.509881 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8e59c430-1c2a-455e-94d0-c376cdf79f7a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083248 Jul 27 20:39:16.510465 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 953/1806] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:16 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:17.448887 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-15cedd0b-7375-4ee4-8ffd-1787120cd7cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:17.449525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-15cedd0b-7375-4ee4-8ffd-1787120cd7cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:17.456040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15cedd0b-7375-4ee4-8ffd-1787120cd7cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.456523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15cedd0b-7375-4ee4-8ffd-1787120cd7cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.457283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15cedd0b-7375-4ee4-8ffd-1787120cd7cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.457713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15cedd0b-7375-4ee4-8ffd-1787120cd7cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.593507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-15cedd0b-7375-4ee4-8ffd-1787120cd7cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:17.602741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-15cedd0b-7375-4ee4-8ffd-1787120cd7cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.157672 Jul 27 20:39:17.603318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 954/1807] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:17 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:17.608854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bab77a4a-6340-45d4-9ad4-98353f99ba05 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:17.609454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bab77a4a-6340-45d4-9ad4-98353f99ba05 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:17.615331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bab77a4a-6340-45d4-9ad4-98353f99ba05 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.615791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bab77a4a-6340-45d4-9ad4-98353f99ba05 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.616610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bab77a4a-6340-45d4-9ad4-98353f99ba05 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.617048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bab77a4a-6340-45d4-9ad4-98353f99ba05 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.677368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bab77a4a-6340-45d4-9ad4-98353f99ba05 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:17.685201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bab77a4a-6340-45d4-9ad4-98353f99ba05 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080961 Jul 27 20:39:17.685768 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 955/1808] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:17 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:18.624176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-df0d6d42-a9eb-4979-9584-d3edc257f7b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:18.624805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-df0d6d42-a9eb-4979-9584-d3edc257f7b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:18.631156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df0d6d42-a9eb-4979-9584-d3edc257f7b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.631599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df0d6d42-a9eb-4979-9584-d3edc257f7b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.632351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df0d6d42-a9eb-4979-9584-d3edc257f7b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.632803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df0d6d42-a9eb-4979-9584-d3edc257f7b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.758886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-df0d6d42-a9eb-4979-9584-d3edc257f7b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:18.766747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-df0d6d42-a9eb-4979-9584-d3edc257f7b8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146726 Jul 27 20:39:18.767317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 956/1809] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:18 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:18.772239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5607ee93-9681-4c8d-a711-6432ce4ae207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:18.772867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5607ee93-9681-4c8d-a711-6432ce4ae207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:18.778355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5607ee93-9681-4c8d-a711-6432ce4ae207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.778803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5607ee93-9681-4c8d-a711-6432ce4ae207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.779552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5607ee93-9681-4c8d-a711-6432ce4ae207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.779991 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5607ee93-9681-4c8d-a711-6432ce4ae207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.842531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5607ee93-9681-4c8d-a711-6432ce4ae207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:18.850399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5607ee93-9681-4c8d-a711-6432ce4ae207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082156 Jul 27 20:39:18.850966 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 957/1810] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:18 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:19.788504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c52cf4f9-b6ee-46c4-b030-cf0a6b593e82 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:19.789152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c52cf4f9-b6ee-46c4-b030-cf0a6b593e82 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:19.795551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c52cf4f9-b6ee-46c4-b030-cf0a6b593e82 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:19.795996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c52cf4f9-b6ee-46c4-b030-cf0a6b593e82 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:19.796772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c52cf4f9-b6ee-46c4-b030-cf0a6b593e82 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:19.797204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c52cf4f9-b6ee-46c4-b030-cf0a6b593e82 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:19.929650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c52cf4f9-b6ee-46c4-b030-cf0a6b593e82 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:19.937626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c52cf4f9-b6ee-46c4-b030-cf0a6b593e82 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153570 Jul 27 20:39:19.938200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 958/1811] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:19 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:19.942650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ccdee933-60a2-447c-897e-878a03cb718b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:19.943289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ccdee933-60a2-447c-897e-878a03cb718b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:19.948808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ccdee933-60a2-447c-897e-878a03cb718b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:19.949258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ccdee933-60a2-447c-897e-878a03cb718b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:19.950013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ccdee933-60a2-447c-897e-878a03cb718b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:19.950448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ccdee933-60a2-447c-897e-878a03cb718b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:20.011899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ccdee933-60a2-447c-897e-878a03cb718b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:20.019749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ccdee933-60a2-447c-897e-878a03cb718b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080621 Jul 27 20:39:20.020321 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 959/1812] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:19 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:20.959166 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9ec9f672-9696-4cfb-9a4f-47e46a63c999 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:20.959854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9ec9f672-9696-4cfb-9a4f-47e46a63c999 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:20.966255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ec9f672-9696-4cfb-9a4f-47e46a63c999 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:20.966693 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ec9f672-9696-4cfb-9a4f-47e46a63c999 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:20.967437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ec9f672-9696-4cfb-9a4f-47e46a63c999 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:20.967857 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ec9f672-9696-4cfb-9a4f-47e46a63c999 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:21.096043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9ec9f672-9696-4cfb-9a4f-47e46a63c999 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:21.103936 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9ec9f672-9696-4cfb-9a4f-47e46a63c999 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149263 Jul 27 20:39:21.104531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 960/1813] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:20 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:21.108860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-808e2f4f-482a-4192-8a6b-835b5bf0437d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:21.109453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-808e2f4f-482a-4192-8a6b-835b5bf0437d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:21.114954 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-808e2f4f-482a-4192-8a6b-835b5bf0437d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:21.115398 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-808e2f4f-482a-4192-8a6b-835b5bf0437d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:21.116137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-808e2f4f-482a-4192-8a6b-835b5bf0437d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:21.116610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-808e2f4f-482a-4192-8a6b-835b5bf0437d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:21.176104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-808e2f4f-482a-4192-8a6b-835b5bf0437d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:21.183912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-808e2f4f-482a-4192-8a6b-835b5bf0437d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.078471 Jul 27 20:39:21.184494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 961/1814] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:21 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:22.125402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8c3540f0-91a5-445e-9ec5-56ab1fb10c6e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:22.126083 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8c3540f0-91a5-445e-9ec5-56ab1fb10c6e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:22.132582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c3540f0-91a5-445e-9ec5-56ab1fb10c6e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.133031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c3540f0-91a5-445e-9ec5-56ab1fb10c6e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:22.133785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c3540f0-91a5-445e-9ec5-56ab1fb10c6e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.134215 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c3540f0-91a5-445e-9ec5-56ab1fb10c6e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:22.259190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8c3540f0-91a5-445e-9ec5-56ab1fb10c6e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:22.266951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8c3540f0-91a5-445e-9ec5-56ab1fb10c6e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145412 Jul 27 20:39:22.267520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 962/1815] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:22 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:22.272466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ca333bd3-8699-45a4-a9f3-8f41551b38e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:22.273112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ca333bd3-8699-45a4-a9f3-8f41551b38e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:22.278534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca333bd3-8699-45a4-a9f3-8f41551b38e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.278979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca333bd3-8699-45a4-a9f3-8f41551b38e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:22.279726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca333bd3-8699-45a4-a9f3-8f41551b38e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.280154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca333bd3-8699-45a4-a9f3-8f41551b38e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:22.343088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ca333bd3-8699-45a4-a9f3-8f41551b38e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:22.351990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ca333bd3-8699-45a4-a9f3-8f41551b38e5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083545 Jul 27 20:39:22.352587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 963/1816] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:22 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:23.289342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9bcbb87b-df34-48dc-9b46-1491248d3ea9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:23.290053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9bcbb87b-df34-48dc-9b46-1491248d3ea9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:23.296310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bcbb87b-df34-48dc-9b46-1491248d3ea9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:23.296862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bcbb87b-df34-48dc-9b46-1491248d3ea9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:23.297616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bcbb87b-df34-48dc-9b46-1491248d3ea9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:23.298052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9bcbb87b-df34-48dc-9b46-1491248d3ea9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:23.313202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:23.425345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9bcbb87b-df34-48dc-9b46-1491248d3ea9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:23.433847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9bcbb87b-df34-48dc-9b46-1491248d3ea9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149055 Jul 27 20:39:23.434417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 964/1817] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:23 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:23.438820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a704bd98-411b-4e3b-afc1-0b76b2170000 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:23.439420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a704bd98-411b-4e3b-afc1-0b76b2170000 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:23.444987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a704bd98-411b-4e3b-afc1-0b76b2170000 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:23.445442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a704bd98-411b-4e3b-afc1-0b76b2170000 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:23.446195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a704bd98-411b-4e3b-afc1-0b76b2170000 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:23.446626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a704bd98-411b-4e3b-afc1-0b76b2170000 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:23.506352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a704bd98-411b-4e3b-afc1-0b76b2170000 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:23.514266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a704bd98-411b-4e3b-afc1-0b76b2170000 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.078925 Jul 27 20:39:23.514830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 965/1818] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:23 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:24.455052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c378b977-b35e-49e7-bbe2-f01be30421ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:24.455697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c378b977-b35e-49e7-bbe2-f01be30421ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:24.462155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c378b977-b35e-49e7-bbe2-f01be30421ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.462596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c378b977-b35e-49e7-bbe2-f01be30421ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.463341 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c378b977-b35e-49e7-bbe2-f01be30421ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.463767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c378b977-b35e-49e7-bbe2-f01be30421ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.598633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c378b977-b35e-49e7-bbe2-f01be30421ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:24.604648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c378b977-b35e-49e7-bbe2-f01be30421ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153392 Jul 27 20:39:24.605226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 966/1819] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:24 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:24.609840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-64c56adf-3f13-417f-a1a3-0f03df0dca92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:24.610492 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-64c56adf-3f13-417f-a1a3-0f03df0dca92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:24.617052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64c56adf-3f13-417f-a1a3-0f03df0dca92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.617500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64c56adf-3f13-417f-a1a3-0f03df0dca92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.618258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64c56adf-3f13-417f-a1a3-0f03df0dca92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.618687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64c56adf-3f13-417f-a1a3-0f03df0dca92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.683874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64c56adf-3f13-417f-a1a3-0f03df0dca92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:24.691711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-64c56adf-3f13-417f-a1a3-0f03df0dca92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085537 Jul 27 20:39:24.692280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 967/1820] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:24 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:25.627161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d3664d79-67f2-4c3a-94fd-83d55b65f363 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:25.627792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d3664d79-67f2-4c3a-94fd-83d55b65f363 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:25.633798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3664d79-67f2-4c3a-94fd-83d55b65f363 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.634247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3664d79-67f2-4c3a-94fd-83d55b65f363 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.635005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3664d79-67f2-4c3a-94fd-83d55b65f363 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.635439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3664d79-67f2-4c3a-94fd-83d55b65f363 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.760229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d3664d79-67f2-4c3a-94fd-83d55b65f363 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:25.768190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d3664d79-67f2-4c3a-94fd-83d55b65f363 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145177 Jul 27 20:39:25.768794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 968/1821] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:25 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:25.773170 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c8d27b2c-14a7-4174-aeed-48c085747230 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:25.773772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c8d27b2c-14a7-4174-aeed-48c085747230 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:25.779230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8d27b2c-14a7-4174-aeed-48c085747230 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.779678 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8d27b2c-14a7-4174-aeed-48c085747230 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.780457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8d27b2c-14a7-4174-aeed-48c085747230 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.780956 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8d27b2c-14a7-4174-aeed-48c085747230 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.844270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c8d27b2c-14a7-4174-aeed-48c085747230 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:25.852732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c8d27b2c-14a7-4174-aeed-48c085747230 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082979 Jul 27 20:39:25.853378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 969/1822] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:25 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:26.789257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d697115b-dbf6-45e2-a3cc-335724f98096 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:26.789939 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d697115b-dbf6-45e2-a3cc-335724f98096 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:26.796342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d697115b-dbf6-45e2-a3cc-335724f98096 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:26.796819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d697115b-dbf6-45e2-a3cc-335724f98096 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:26.797577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d697115b-dbf6-45e2-a3cc-335724f98096 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:26.798012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d697115b-dbf6-45e2-a3cc-335724f98096 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:26.923790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d697115b-dbf6-45e2-a3cc-335724f98096 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:26.931701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d697115b-dbf6-45e2-a3cc-335724f98096 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147010 Jul 27 20:39:26.934989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 970/1823] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:26 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:26.936599 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b7d4244f-0689-4460-8075-15e3436c042f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:26.937206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b7d4244f-0689-4460-8075-15e3436c042f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:26.943183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7d4244f-0689-4460-8075-15e3436c042f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:26.943635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7d4244f-0689-4460-8075-15e3436c042f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:26.944404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7d4244f-0689-4460-8075-15e3436c042f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:26.944850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7d4244f-0689-4460-8075-15e3436c042f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:27.004093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b7d4244f-0689-4460-8075-15e3436c042f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:27.012478 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b7d4244f-0689-4460-8075-15e3436c042f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.079239 Jul 27 20:39:27.013053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 971/1824] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:26 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:27.953329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6be9735a-af6f-4598-be96-b951186ffa38 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:27.954008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6be9735a-af6f-4598-be96-b951186ffa38 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:27.961135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6be9735a-af6f-4598-be96-b951186ffa38 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:27.961585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6be9735a-af6f-4598-be96-b951186ffa38 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:27.962338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6be9735a-af6f-4598-be96-b951186ffa38 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:27.962769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6be9735a-af6f-4598-be96-b951186ffa38 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:28.092899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6be9735a-af6f-4598-be96-b951186ffa38 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:28.101030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6be9735a-af6f-4598-be96-b951186ffa38 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151604 Jul 27 20:39:28.103339 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 972/1825] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:27 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:28.106171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-86cee929-be08-43ae-96f9-57beff78b2d1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:28.106764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-86cee929-be08-43ae-96f9-57beff78b2d1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:28.112226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-86cee929-be08-43ae-96f9-57beff78b2d1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:28.112699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-86cee929-be08-43ae-96f9-57beff78b2d1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:28.113445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-86cee929-be08-43ae-96f9-57beff78b2d1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:28.113867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-86cee929-be08-43ae-96f9-57beff78b2d1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:28.174158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-86cee929-be08-43ae-96f9-57beff78b2d1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:28.182387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-86cee929-be08-43ae-96f9-57beff78b2d1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.079800 Jul 27 20:39:28.182950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 973/1826] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:28 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:29.123325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8475bae2-aed5-41b2-b696-ac45d6120efb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:29.124009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8475bae2-aed5-41b2-b696-ac45d6120efb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:29.131024 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8475bae2-aed5-41b2-b696-ac45d6120efb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:29.131461 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8475bae2-aed5-41b2-b696-ac45d6120efb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:29.132194 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8475bae2-aed5-41b2-b696-ac45d6120efb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:29.132649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8475bae2-aed5-41b2-b696-ac45d6120efb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:29.257797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8475bae2-aed5-41b2-b696-ac45d6120efb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:29.265655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8475bae2-aed5-41b2-b696-ac45d6120efb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146421 Jul 27 20:39:29.266232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 974/1827] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:29 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:29.270533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3016cc55-525f-4238-800a-18a995b68b9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:29.271134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3016cc55-525f-4238-800a-18a995b68b9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:29.276652 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3016cc55-525f-4238-800a-18a995b68b9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:29.277104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3016cc55-525f-4238-800a-18a995b68b9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:29.277870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3016cc55-525f-4238-800a-18a995b68b9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:29.278304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3016cc55-525f-4238-800a-18a995b68b9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:29.343369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3016cc55-525f-4238-800a-18a995b68b9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:29.351773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3016cc55-525f-4238-800a-18a995b68b9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084604 Jul 27 20:39:29.352353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 975/1828] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:29 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:30.287235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-81b8e9cc-900e-44d2-9511-55d6158d91fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:30.287932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-81b8e9cc-900e-44d2-9511-55d6158d91fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:30.294299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81b8e9cc-900e-44d2-9511-55d6158d91fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.294745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81b8e9cc-900e-44d2-9511-55d6158d91fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.295501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81b8e9cc-900e-44d2-9511-55d6158d91fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.295934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81b8e9cc-900e-44d2-9511-55d6158d91fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.422104 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-81b8e9cc-900e-44d2-9511-55d6158d91fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:30.430469 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-81b8e9cc-900e-44d2-9511-55d6158d91fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147188 Jul 27 20:39:30.431029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 976/1829] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:30 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:30.435298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e67fbb02-041d-4ac8-b364-7bb9ec1c507b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:30.435894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e67fbb02-041d-4ac8-b364-7bb9ec1c507b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:30.441306 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e67fbb02-041d-4ac8-b364-7bb9ec1c507b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.441748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e67fbb02-041d-4ac8-b364-7bb9ec1c507b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.443122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e67fbb02-041d-4ac8-b364-7bb9ec1c507b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.443588 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e67fbb02-041d-4ac8-b364-7bb9ec1c507b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.503683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e67fbb02-041d-4ac8-b364-7bb9ec1c507b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:30.513036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e67fbb02-041d-4ac8-b364-7bb9ec1c507b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080248 Jul 27 20:39:30.513681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 977/1830] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:30 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:31.451062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6e936317-c4fd-4b03-b985-dcfcc2580c79 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:31.451676 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6e936317-c4fd-4b03-b985-dcfcc2580c79 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:31.458233 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e936317-c4fd-4b03-b985-dcfcc2580c79 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.458681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e936317-c4fd-4b03-b985-dcfcc2580c79 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.459434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e936317-c4fd-4b03-b985-dcfcc2580c79 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.459865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6e936317-c4fd-4b03-b985-dcfcc2580c79 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.588143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6e936317-c4fd-4b03-b985-dcfcc2580c79 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:31.595945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6e936317-c4fd-4b03-b985-dcfcc2580c79 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148779 Jul 27 20:39:31.596535 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 978/1831] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:31 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:31.601271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dc02f8d8-ec02-44b0-bed4-eb39285b6edf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:31.601917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dc02f8d8-ec02-44b0-bed4-eb39285b6edf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:31.607334 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dc02f8d8-ec02-44b0-bed4-eb39285b6edf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.607765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dc02f8d8-ec02-44b0-bed4-eb39285b6edf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.608538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dc02f8d8-ec02-44b0-bed4-eb39285b6edf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.608960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dc02f8d8-ec02-44b0-bed4-eb39285b6edf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.668366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dc02f8d8-ec02-44b0-bed4-eb39285b6edf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:31.676116 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dc02f8d8-ec02-44b0-bed4-eb39285b6edf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.078669 Jul 27 20:39:31.677316 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 979/1832] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:31 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:32.617178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-52210af7-ca43-441b-863c-e122a717a8cf tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:32.617784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-52210af7-ca43-441b-863c-e122a717a8cf tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:32.624589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52210af7-ca43-441b-863c-e122a717a8cf tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:32.625042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52210af7-ca43-441b-863c-e122a717a8cf tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:32.625801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52210af7-ca43-441b-863c-e122a717a8cf tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:32.626235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-52210af7-ca43-441b-863c-e122a717a8cf tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:32.753507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-52210af7-ca43-441b-863c-e122a717a8cf tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:32.762005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-52210af7-ca43-441b-863c-e122a717a8cf tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149275 Jul 27 20:39:32.762579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 980/1833] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:32 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:32.766871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-99198170-5379-4ac3-94e3-653085095421 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:32.767476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-99198170-5379-4ac3-94e3-653085095421 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:32.773074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99198170-5379-4ac3-94e3-653085095421 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:32.773527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99198170-5379-4ac3-94e3-653085095421 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:32.774280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99198170-5379-4ac3-94e3-653085095421 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:32.774714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99198170-5379-4ac3-94e3-653085095421 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:32.778598 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:32.837854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-99198170-5379-4ac3-94e3-653085095421 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:32.845684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-99198170-5379-4ac3-94e3-653085095421 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082174 Jul 27 20:39:32.846261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 981/1834] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:32 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:33.782923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c4ce5e6c-2afd-495f-b113-d30b6f2e5131 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:33.783583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c4ce5e6c-2afd-495f-b113-d30b6f2e5131 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:33.790089 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4ce5e6c-2afd-495f-b113-d30b6f2e5131 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.790540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4ce5e6c-2afd-495f-b113-d30b6f2e5131 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.791299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4ce5e6c-2afd-495f-b113-d30b6f2e5131 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.791733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4ce5e6c-2afd-495f-b113-d30b6f2e5131 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.919043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c4ce5e6c-2afd-495f-b113-d30b6f2e5131 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:33.926923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c4ce5e6c-2afd-495f-b113-d30b6f2e5131 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147992 Jul 27 20:39:33.927494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 982/1835] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:33 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:33.931814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-529a6f11-124d-4663-a291-b7635e06cc27 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:33.932443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-529a6f11-124d-4663-a291-b7635e06cc27 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:33.937860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-529a6f11-124d-4663-a291-b7635e06cc27 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.938311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-529a6f11-124d-4663-a291-b7635e06cc27 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.939067 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-529a6f11-124d-4663-a291-b7635e06cc27 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.939504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-529a6f11-124d-4663-a291-b7635e06cc27 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:34.000715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-529a6f11-124d-4663-a291-b7635e06cc27 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:34.009076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-529a6f11-124d-4663-a291-b7635e06cc27 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080662 Jul 27 20:39:34.009669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 983/1836] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:33 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:34.947888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ac2fbf39-fe3b-4dc7-98d0-3c59d86e56f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:34.948604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ac2fbf39-fe3b-4dc7-98d0-3c59d86e56f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:34.954945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac2fbf39-fe3b-4dc7-98d0-3c59d86e56f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:34.955384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac2fbf39-fe3b-4dc7-98d0-3c59d86e56f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:34.956123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac2fbf39-fe3b-4dc7-98d0-3c59d86e56f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:34.956592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac2fbf39-fe3b-4dc7-98d0-3c59d86e56f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:35.085689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ac2fbf39-fe3b-4dc7-98d0-3c59d86e56f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:35.093553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ac2fbf39-fe3b-4dc7-98d0-3c59d86e56f6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149461 Jul 27 20:39:35.094113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 984/1837] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:34 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:35.098959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-22b06ab8-6de5-4ec5-bb4d-9e292bf092ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:35.099523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-22b06ab8-6de5-4ec5-bb4d-9e292bf092ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:35.105102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22b06ab8-6de5-4ec5-bb4d-9e292bf092ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:35.105545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22b06ab8-6de5-4ec5-bb4d-9e292bf092ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:35.106289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22b06ab8-6de5-4ec5-bb4d-9e292bf092ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:35.106713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22b06ab8-6de5-4ec5-bb4d-9e292bf092ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:35.165931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-22b06ab8-6de5-4ec5-bb4d-9e292bf092ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:35.173728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-22b06ab8-6de5-4ec5-bb4d-9e292bf092ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.078693 Jul 27 20:39:35.174292 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 985/1838] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:35 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:36.115772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7613eec5-888e-43c8-961c-266b8ce1141f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:36.116481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7613eec5-888e-43c8-961c-266b8ce1141f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:36.123288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7613eec5-888e-43c8-961c-266b8ce1141f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:36.123734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7613eec5-888e-43c8-961c-266b8ce1141f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:36.124515 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7613eec5-888e-43c8-961c-266b8ce1141f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:36.124949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7613eec5-888e-43c8-961c-266b8ce1141f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:36.251741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7613eec5-888e-43c8-961c-266b8ce1141f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:36.260086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7613eec5-888e-43c8-961c-266b8ce1141f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148833 Jul 27 20:39:36.260698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 986/1839] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:36 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:36.264994 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d43369bf-a3bd-4430-8bdb-b6b11e924616 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:36.265592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d43369bf-a3bd-4430-8bdb-b6b11e924616 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:36.271052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d43369bf-a3bd-4430-8bdb-b6b11e924616 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:36.271498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d43369bf-a3bd-4430-8bdb-b6b11e924616 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:36.272247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d43369bf-a3bd-4430-8bdb-b6b11e924616 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:36.272703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d43369bf-a3bd-4430-8bdb-b6b11e924616 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:36.336118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d43369bf-a3bd-4430-8bdb-b6b11e924616 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:36.344259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d43369bf-a3bd-4430-8bdb-b6b11e924616 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082620 Jul 27 20:39:36.344908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 987/1840] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:36 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:37.281329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-82859fc4-68b9-4026-ba6c-de5a3bf1655d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:37.281991 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-82859fc4-68b9-4026-ba6c-de5a3bf1655d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:37.289088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82859fc4-68b9-4026-ba6c-de5a3bf1655d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:37.289538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82859fc4-68b9-4026-ba6c-de5a3bf1655d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:37.290296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82859fc4-68b9-4026-ba6c-de5a3bf1655d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:37.290730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82859fc4-68b9-4026-ba6c-de5a3bf1655d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:37.418026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-82859fc4-68b9-4026-ba6c-de5a3bf1655d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:37.425796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-82859fc4-68b9-4026-ba6c-de5a3bf1655d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148453 Jul 27 20:39:37.426363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 988/1841] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:37 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:37.430621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-483da05d-de2b-4ff1-90bb-6312126eb8fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:37.431211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-483da05d-de2b-4ff1-90bb-6312126eb8fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:37.436848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-483da05d-de2b-4ff1-90bb-6312126eb8fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:37.437298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-483da05d-de2b-4ff1-90bb-6312126eb8fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:37.438048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-483da05d-de2b-4ff1-90bb-6312126eb8fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:37.438478 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-483da05d-de2b-4ff1-90bb-6312126eb8fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:37.497825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-483da05d-de2b-4ff1-90bb-6312126eb8fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:37.506161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-483da05d-de2b-4ff1-90bb-6312126eb8fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.078884 Jul 27 20:39:37.506732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 989/1842] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:37 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:38.446903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-53f15c78-3b3f-423a-956a-bec68461e125 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:38.447522 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-53f15c78-3b3f-423a-956a-bec68461e125 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:38.453961 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53f15c78-3b3f-423a-956a-bec68461e125 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:38.454397 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53f15c78-3b3f-423a-956a-bec68461e125 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:38.455137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53f15c78-3b3f-423a-956a-bec68461e125 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:38.455563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53f15c78-3b3f-423a-956a-bec68461e125 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:38.584947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-53f15c78-3b3f-423a-956a-bec68461e125 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:38.593263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-53f15c78-3b3f-423a-956a-bec68461e125 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150140 Jul 27 20:39:38.593775 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 990/1843] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:38 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:38.598088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d34f881d-0d9c-4ec5-89ce-f481c1329626 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:38.599312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d34f881d-0d9c-4ec5-89ce-f481c1329626 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:38.604914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d34f881d-0d9c-4ec5-89ce-f481c1329626 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:38.605355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d34f881d-0d9c-4ec5-89ce-f481c1329626 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:38.606110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d34f881d-0d9c-4ec5-89ce-f481c1329626 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:38.606534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d34f881d-0d9c-4ec5-89ce-f481c1329626 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:38.667549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d34f881d-0d9c-4ec5-89ce-f481c1329626 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:38.675359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d34f881d-0d9c-4ec5-89ce-f481c1329626 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080657 Jul 27 20:39:38.675927 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 991/1844] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:38 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:39.614866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-26e6923a-33ca-4abe-bc38-ba9b701ff04a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:39.615501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-26e6923a-33ca-4abe-bc38-ba9b701ff04a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:39.622105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26e6923a-33ca-4abe-bc38-ba9b701ff04a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:39.622540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26e6923a-33ca-4abe-bc38-ba9b701ff04a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:39.623274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26e6923a-33ca-4abe-bc38-ba9b701ff04a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:39.623696 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26e6923a-33ca-4abe-bc38-ba9b701ff04a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:39.901498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-26e6923a-33ca-4abe-bc38-ba9b701ff04a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:39.909417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-26e6923a-33ca-4abe-bc38-ba9b701ff04a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.298480 Jul 27 20:39:39.909984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 992/1845] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:39 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:39.914279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2877d5c7-a7c6-4935-8b40-d0a63711dcf5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:39.914882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2877d5c7-a7c6-4935-8b40-d0a63711dcf5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:39.920335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2877d5c7-a7c6-4935-8b40-d0a63711dcf5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:39.920818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2877d5c7-a7c6-4935-8b40-d0a63711dcf5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:39.921573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2877d5c7-a7c6-4935-8b40-d0a63711dcf5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:39.922010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2877d5c7-a7c6-4935-8b40-d0a63711dcf5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:39.985360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2877d5c7-a7c6-4935-8b40-d0a63711dcf5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:39.993813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2877d5c7-a7c6-4935-8b40-d0a63711dcf5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082910 Jul 27 20:39:39.994398 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 993/1846] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:39 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:40.905020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:40.905682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:40.912807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:40.913253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:40.914010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:40.914439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:40.938443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:39:40.944103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.compute.api [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Working on deleting snapshot 436ed020-e3cc-410f-8fde-f03283c23d28 from shelved instance... Jul 27 20:39:40.990410 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: WARNING nova.compute.api [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Failed to delete snapshot from shelved instance (Image 436ed020-e3cc-410f-8fde-f03283c23d28 could not be found.).: nova.exception.ImageNotFound: Image 436ed020-e3cc-410f-8fde-f03283c23d28 could not be found. Jul 27 20:39:41.106984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Doing local delete in cell deef0dc2-6aba-4ad7-810e-4420c759a7c1(cell1) {{(pid=118274) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 27 20:39:41.107771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:41.108210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:41.108655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.compute.api [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 27 20:39:41.116009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] deallocate_for_instance() {{(pid=118274) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 27 20:39:41.149602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Instance cache missing network info. {{(pid=118274) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 27 20:39:41.157418 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Updating instance_info_cache with network_info: [] {{(pid=118274) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 27 20:39:51.104920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=89 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:51.166319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:09.858457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:40:09.859081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:40:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef (ip 10.222.0.47) !!! Jul 27 20:40:41.201395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: WARNING nova.volume.cinder [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Attachment edd68020-0b57-4878-b8bf-edafb9dae714 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = edd68020-0b57-4878-b8bf-edafb9dae714. (HTTP 404) (Request-ID: req-ace479c1-9bc6-4ae5-866c-9c62af6306aa) Jul 27 20:40:41.609004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.scheduler.client.report [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Deleted allocations for instance 0929536d-2d91-4e59-8f36-474025d921ef Jul 27 20:40:41.610042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.scheduler.client.report [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Deleted allocations for instance 0929536d-2d91-4e59-8f36-474025d921ef Jul 27 20:40:41.953817 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-748c3bfc-5c3a-49c8-9bab-66fa0aa53484 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 204 len: 0 microversion: 2.20 time: 61.053905 Jul 27 20:40:41.954403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 994/1847] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 20:39:40 2022] DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 0 bytes in 61055 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 20:40:41.960368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73f7ad85-f48b-4f29-9c5c-f29c95091d36 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:41.961137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-73f7ad85-f48b-4f29-9c5c-f29c95091d36 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:41.967111 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73f7ad85-f48b-4f29-9c5c-f29c95091d36 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:41.967558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73f7ad85-f48b-4f29-9c5c-f29c95091d36 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:41.968317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73f7ad85-f48b-4f29-9c5c-f29c95091d36 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:41.968787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73f7ad85-f48b-4f29-9c5c-f29c95091d36 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Unexpected exception in API method: nova.exception.ObjectActionError: Object action destroy failed because: host changed Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance.py", line 654, in destroy Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi db_inst = db.instance_destroy(self._context, self.uuid, Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi ectxt.value = e.inner_exc Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise self.value Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 207, in wrapper Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 1336, in instance_destroy Jul 27 20:40:41.976134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.ConstraintNotMet() Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.ConstraintNotMet: Constraint not met. Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 903, in _delete Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.compute_api.delete(context, instance) Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2668, in delete Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete_instance(context, instance) Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2659, in _delete_instance Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(context, instance, 'delete', self._do_delete, Jul 27 20:40:41.977740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2495, in _delete Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._local_delete(cctxt, instance, bdms, delete_type, cb) Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2609, in _local_delete Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance.destroy() Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance.py", line 659, in destroy Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.ObjectActionError(action='destroy', Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.ObjectActionError: Object action destroy failed because: host changed Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef HTTP/1.1 Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:40:41.979341 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:40:41.981003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '0929536d-2d91-4e59-8f36-474025d921ef'} Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance.py", line 654, in destroy Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi db_inst = db.instance_destroy(self._context, self.uuid, Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi ectxt.value = e.inner_exc Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise self.value Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Jul 27 20:40:41.982229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 207, in wrapper Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 1336, in instance_destroy Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.ConstraintNotMet() Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.ConstraintNotMet: Constraint not met. Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 903, in _delete Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.compute_api.delete(context, instance) Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2668, in delete Jul 27 20:40:41.984049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete_instance(context, instance) Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2659, in _delete_instance Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(context, instance, 'delete', self._do_delete, Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2495, in _delete Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._local_delete(cctxt, instance, bdms, delete_type, cb) Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2609, in _local_delete Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance.destroy() Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance.py", line 659, in destroy Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.ObjectActionError(action='destroy', Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.ObjectActionError: Object action destroy failed because: host changed Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:40:41.985608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jul 27 20:40:41.987029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:40:41.988408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-637c0607-7f6e-4020-819b-0b675e18bc07 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 500 len: 206 microversion: 2.20 time: 121.141693 Jul 27 20:40:41.988408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 854/1848] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 20:38:40 2022] DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 206 bytes in 121143 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Jul 27 20:40:41.988408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f4e20345-7ad9-4bbc-8f7b-8422a0eb2fba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:41.988685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f4e20345-7ad9-4bbc-8f7b-8422a0eb2fba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:41.995370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4e20345-7ad9-4bbc-8f7b-8422a0eb2fba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:41.995825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4e20345-7ad9-4bbc-8f7b-8422a0eb2fba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:41.996621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4e20345-7ad9-4bbc-8f7b-8422a0eb2fba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:41.997061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f4e20345-7ad9-4bbc-8f7b-8422a0eb2fba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.066363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f4e20345-7ad9-4bbc-8f7b-8422a0eb2fba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:42.074597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f4e20345-7ad9-4bbc-8f7b-8422a0eb2fba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.091766 Jul 27 20:40:42.075171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 855/1849] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:41 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:42.079596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:42.080095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:42.085871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.086321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.087077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.087512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.101235 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef HTTP/1.1 Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:40:42.102794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:40:42.104283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '0929536d-2d91-4e59-8f36-474025d921ef'} Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:40:42.105107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:40:42.106356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:40:42.107572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 404 to user: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:40:42.107572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b245715d-1980-4beb-9c38-5103c371abfa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 404 len: 111 microversion: 2.20 time: 0.028090 Jul 27 20:40:42.107572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 856/1850] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 20:40:42 2022] DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:40:42.112142 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3d80a57a-5a1a-4eeb-9217-8886342d9c28 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:42.112782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3d80a57a-5a1a-4eeb-9217-8886342d9c28 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:42.119473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d80a57a-5a1a-4eeb-9217-8886342d9c28 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.119921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d80a57a-5a1a-4eeb-9217-8886342d9c28 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.120985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d80a57a-5a1a-4eeb-9217-8886342d9c28 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.121420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3d80a57a-5a1a-4eeb-9217-8886342d9c28 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.128499 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-73f7ad85-f48b-4f29-9c5c-f29c95091d36 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:42.136256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-73f7ad85-f48b-4f29-9c5c-f29c95091d36 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.180741 Jul 27 20:40:42.136844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 995/1851] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:41 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:42.141155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-37322d8f-e3fc-4ba7-9860-5dc80eef3004 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:42.141748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-37322d8f-e3fc-4ba7-9860-5dc80eef3004 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:42.147190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-37322d8f-e3fc-4ba7-9860-5dc80eef3004 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.147630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-37322d8f-e3fc-4ba7-9860-5dc80eef3004 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.148372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-37322d8f-e3fc-4ba7-9860-5dc80eef3004 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.148823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-37322d8f-e3fc-4ba7-9860-5dc80eef3004 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.218923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-37322d8f-e3fc-4ba7-9860-5dc80eef3004 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:42.227306 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-37322d8f-e3fc-4ba7-9860-5dc80eef3004 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.089526 Jul 27 20:40:42.227886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 996/1852] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:42 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:42.233323 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-290022ee-35c2-4192-aa01-d0699db23e69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '.version_select at 0x7f35ca613430>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:42.275283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3d80a57a-5a1a-4eeb-9217-8886342d9c28 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:42.284110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3d80a57a-5a1a-4eeb-9217-8886342d9c28 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.178429 Jul 27 20:40:42.289647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 857/1853] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:42 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:42.310603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-290022ee-35c2-4192-aa01-d0699db23e69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-275638179" status: 204 len: 0 microversion: 2.20 time: 0.080796 Jul 27 20:40:42.311262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 997/1854] 10.222.0.47 () {60 vars in 1259 bytes} [Wed Jul 27 20:40:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-275638179 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 20:40:43.174972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-915608cb-fe67-414d-bd38-1950beecdaaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Action: 'create', calling method: .version_select at 0x7f35ca5525e0>, body: {"keypair": {"name": "tempest-keypair-1717186761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Pfu+BZSOPl1AiKdOdygtXvj1K6/CDTL0Ub5L7q4opYI98woKx+gKFQ0Pt76A0FOmTnZGRyyx16RfMoIUq/+klbllYCvF7lnL8mAn7mv1MT80fIyhhmqH+h+CoW5GsOg=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:40:43.191197 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-915608cb-fe67-414d-bd38-1950beecdaaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Getting quotas for project a74675480e734145a1692641342c3e99. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:40:43.195580 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-915608cb-fe67-414d-bd38-1950beecdaaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Getting quotas for user caca4eade01642af9322aa72f7443726 and project a74675480e734145a1692641342c3e99. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:40:43.248727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-778ec54f-0c9c-475f-bfc5-fd05f2937307 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:43.249520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-778ec54f-0c9c-475f-bfc5-fd05f2937307 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:43.256717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-778ec54f-0c9c-475f-bfc5-fd05f2937307 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:43.260429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-778ec54f-0c9c-475f-bfc5-fd05f2937307 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:43.260429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-778ec54f-0c9c-475f-bfc5-fd05f2937307 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:43.260429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-778ec54f-0c9c-475f-bfc5-fd05f2937307 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:43.311069 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-915608cb-fe67-414d-bd38-1950beecdaaa tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.140222 Jul 27 20:40:43.311851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 858/1855] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Jul 27 20:40:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 27 20:40:43.317257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c63e277d-306e-4c3f-904b-0daf35f1bdb0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:43.318936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c63e277d-306e-4c3f-904b-0daf35f1bdb0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:43.325868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-778ec54f-0c9c-475f-bfc5-fd05f2937307 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:43.326607 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c63e277d-306e-4c3f-904b-0daf35f1bdb0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:43.327059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c63e277d-306e-4c3f-904b-0daf35f1bdb0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:43.327872 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c63e277d-306e-4c3f-904b-0daf35f1bdb0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:43.328519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c63e277d-306e-4c3f-904b-0daf35f1bdb0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:43.334433 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-778ec54f-0c9c-475f-bfc5-fd05f2937307 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.090321 Jul 27 20:40:43.335660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 998/1856] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:43 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:43.456725 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c63e277d-306e-4c3f-904b-0daf35f1bdb0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:43.464850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c63e277d-306e-4c3f-904b-0daf35f1bdb0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151876 Jul 27 20:40:43.465518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 859/1857] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:43 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:44.355660 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eead9635-e1b3-4128-819c-126d3cb27b96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:44.365785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eead9635-e1b3-4128-819c-126d3cb27b96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:44.365785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eead9635-e1b3-4128-819c-126d3cb27b96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:44.365785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eead9635-e1b3-4128-819c-126d3cb27b96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:44.365785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eead9635-e1b3-4128-819c-126d3cb27b96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:44.366258 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eead9635-e1b3-4128-819c-126d3cb27b96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:44.439550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eead9635-e1b3-4128-819c-126d3cb27b96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:44.447937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eead9635-e1b3-4128-819c-126d3cb27b96 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.096562 Jul 27 20:40:44.448531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 999/1858] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:44 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:44.486616 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-40828f31-9008-40c3-9953-94e16965630b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:44.487234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-40828f31-9008-40c3-9953-94e16965630b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:44.494375 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40828f31-9008-40c3-9953-94e16965630b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:44.494832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40828f31-9008-40c3-9953-94e16965630b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:44.495853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40828f31-9008-40c3-9953-94e16965630b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:44.496501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40828f31-9008-40c3-9953-94e16965630b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:44.692233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-40828f31-9008-40c3-9953-94e16965630b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:44.698857 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-40828f31-9008-40c3-9953-94e16965630b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.216304 Jul 27 20:40:44.700037 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 860/1859] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:44 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:45.469474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-59ce41f1-e3f6-4ed8-bd26-1dc36eb7736a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:45.470183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-59ce41f1-e3f6-4ed8-bd26-1dc36eb7736a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:45.477553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59ce41f1-e3f6-4ed8-bd26-1dc36eb7736a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:45.478028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59ce41f1-e3f6-4ed8-bd26-1dc36eb7736a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:45.478788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59ce41f1-e3f6-4ed8-bd26-1dc36eb7736a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:45.479211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59ce41f1-e3f6-4ed8-bd26-1dc36eb7736a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:45.540082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-59ce41f1-e3f6-4ed8-bd26-1dc36eb7736a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:45.548118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-59ce41f1-e3f6-4ed8-bd26-1dc36eb7736a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082618 Jul 27 20:40:45.548811 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1000/1860] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:45 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:45.720109 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1e882d81-d928-4066-9b74-74ca556a06fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:45.721512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1e882d81-d928-4066-9b74-74ca556a06fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:45.728152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e882d81-d928-4066-9b74-74ca556a06fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:45.728639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e882d81-d928-4066-9b74-74ca556a06fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:45.729408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e882d81-d928-4066-9b74-74ca556a06fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:45.729839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e882d81-d928-4066-9b74-74ca556a06fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:45.866066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1e882d81-d928-4066-9b74-74ca556a06fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:45.874629 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1e882d81-d928-4066-9b74-74ca556a06fa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.158295 Jul 27 20:40:45.875216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 861/1861] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:45 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:45.904498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-694555013", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f744f7bc-35f9-4947-a9a1-81fcf2e819d6"}], "security_groups": [{"name": "tempest-securitygroup--130080336"}], "key_name": "tempest-keypair-1717186761", "user_data": "}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:40:46.009675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] validate_networks() for [('f744f7bc-35f9-4947-a9a1-81fcf2e819d6', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:40:46.435380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:40:46.435804 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:40:46.436277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:40:46.436869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:40:46.437271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:40:46.446010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:46.446458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:46.447261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:46.447694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:46.463972 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Getting quotas for project a74675480e734145a1692641342c3e99. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:40:46.467944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Getting quotas for user caca4eade01642af9322aa72f7443726 and project a74675480e734145a1692641342c3e99. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:40:46.479652 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:40:46.481907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:40:46.572120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2a51f109-fcd5-48c2-8112-df0f3549092b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:46.572774 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2a51f109-fcd5-48c2-8112-df0f3549092b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:46.580651 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a51f109-fcd5-48c2-8112-df0f3549092b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:46.581097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a51f109-fcd5-48c2-8112-df0f3549092b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:46.581916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a51f109-fcd5-48c2-8112-df0f3549092b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:46.582735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a51f109-fcd5-48c2-8112-df0f3549092b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:46.593032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d5b7a8b5-a103-4687-8f09-5eb8c0a8999d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.692831 Jul 27 20:40:46.593730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1001/1862] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Jul 27 20:40:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 20:40:46.605126 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b88f69ac-ef5e-46ea-8dbd-e289accb25ae tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:46.605739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b88f69ac-ef5e-46ea-8dbd-e289accb25ae tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:46.658337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2a51f109-fcd5-48c2-8112-df0f3549092b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:46.668135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2a51f109-fcd5-48c2-8112-df0f3549092b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.103855 Jul 27 20:40:46.669042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 862/1863] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:46 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:46.675471 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b88f69ac-ef5e-46ea-8dbd-e289accb25ae tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:46.682771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b88f69ac-ef5e-46ea-8dbd-e289accb25ae tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:46.684319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b88f69ac-ef5e-46ea-8dbd-e289accb25ae tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:46.685393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b88f69ac-ef5e-46ea-8dbd-e289accb25ae tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1281 microversion: 2.20 time: 0.084080 Jul 27 20:40:46.685934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1002/1864] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:46 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:46.897241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7159ed75-1464-47ea-b8b1-3236360c7bd7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:46.897858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7159ed75-1464-47ea-b8b1-3236360c7bd7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:46.904397 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7159ed75-1464-47ea-b8b1-3236360c7bd7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:46.904862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7159ed75-1464-47ea-b8b1-3236360c7bd7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:46.905624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7159ed75-1464-47ea-b8b1-3236360c7bd7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:46.906081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7159ed75-1464-47ea-b8b1-3236360c7bd7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:47.043861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7159ed75-1464-47ea-b8b1-3236360c7bd7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:47.051694 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7159ed75-1464-47ea-b8b1-3236360c7bd7 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.158396 Jul 27 20:40:47.052785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 863/1865] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:46 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:47.689261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-06675b03-d57e-4d6d-b814-d0c46c439a9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:47.689868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-06675b03-d57e-4d6d-b814-d0c46c439a9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:47.696357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06675b03-d57e-4d6d-b814-d0c46c439a9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:47.696832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06675b03-d57e-4d6d-b814-d0c46c439a9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:47.697593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06675b03-d57e-4d6d-b814-d0c46c439a9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:47.698026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06675b03-d57e-4d6d-b814-d0c46c439a9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:47.707065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:47.707923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:47.714765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:47.715302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:47.716076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:47.716556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:47.763367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-06675b03-d57e-4d6d-b814-d0c46c439a9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:47.772423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-06675b03-d57e-4d6d-b814-d0c46c439a9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086997 Jul 27 20:40:47.773146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1003/1866] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:47 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:47.790455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:47.798484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:47.799924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:47.801061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b284bf29-2ede-40d7-bfc0-a4bf9806bc0d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1277 microversion: 2.20 time: 0.098010 Jul 27 20:40:47.801627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 864/1867] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:47 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:40:48.073713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2f4c3742-bcd4-4108-811c-46214576f518 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:48.074476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2f4c3742-bcd4-4108-811c-46214576f518 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:48.080914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f4c3742-bcd4-4108-811c-46214576f518 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.081369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f4c3742-bcd4-4108-811c-46214576f518 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.082137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f4c3742-bcd4-4108-811c-46214576f518 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.082567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f4c3742-bcd4-4108-811c-46214576f518 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.209253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2f4c3742-bcd4-4108-811c-46214576f518 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:48.217068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2f4c3742-bcd4-4108-811c-46214576f518 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147612 Jul 27 20:40:48.217650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1004/1868] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:48 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:48.317903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:40:48.318137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:40:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:40:48.793506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0226a68e-3cae-426b-872e-712596947e04 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:48.794137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0226a68e-3cae-426b-872e-712596947e04 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:48.800602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0226a68e-3cae-426b-872e-712596947e04 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.802340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0226a68e-3cae-426b-872e-712596947e04 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.802340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0226a68e-3cae-426b-872e-712596947e04 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.802340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0226a68e-3cae-426b-872e-712596947e04 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.826914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:48.826914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:48.832906 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.834175 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.834946 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.835377 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.878785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0226a68e-3cae-426b-872e-712596947e04 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:48.887428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0226a68e-3cae-426b-872e-712596947e04 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.097716 Jul 27 20:40:48.888002 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 865/1869] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:48 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:48.938576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:48.948021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:48.951419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:48.951995 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-abbeb1e1-cbdf-461a-9066-2f1c249435df tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1351 microversion: 2.20 time: 0.132205 Jul 27 20:40:48.953626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1005/1870] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:48 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:40:49.239318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4853db2d-d58d-45a4-8ac5-c61e337abbb2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:49.240603 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4853db2d-d58d-45a4-8ac5-c61e337abbb2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:49.247991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4853db2d-d58d-45a4-8ac5-c61e337abbb2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.248560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4853db2d-d58d-45a4-8ac5-c61e337abbb2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:49.249638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4853db2d-d58d-45a4-8ac5-c61e337abbb2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.250540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4853db2d-d58d-45a4-8ac5-c61e337abbb2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:49.444839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4853db2d-d58d-45a4-8ac5-c61e337abbb2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:49.452842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4853db2d-d58d-45a4-8ac5-c61e337abbb2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.217929 Jul 27 20:40:49.453427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 866/1871] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:49 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:49.914380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-644951c8-a85c-467e-b6ba-a38349fc8689 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:49.914380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-644951c8-a85c-467e-b6ba-a38349fc8689 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:49.920968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-644951c8-a85c-467e-b6ba-a38349fc8689 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.921460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-644951c8-a85c-467e-b6ba-a38349fc8689 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:49.922247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-644951c8-a85c-467e-b6ba-a38349fc8689 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.922587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-644951c8-a85c-467e-b6ba-a38349fc8689 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:49.976562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:49.977109 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:49.983765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.984242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:49.985238 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.985683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:50.001673 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-644951c8-a85c-467e-b6ba-a38349fc8689 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:50.010414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-644951c8-a85c-467e-b6ba-a38349fc8689 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.105396 Jul 27 20:40:50.017311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1006/1872] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:49 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:50.163032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-6abe3ebd-0da9-4432-ab86-1c676a216554 req-0edae54f-b4ce-4253-97c9-9ed66c896973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2351ed2-58ed-4953-b7a6-5c4773b2598a", "tag": "01db6eee-31a9-4f2e-be4c-31e4d1b8441b"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:40:50.172672 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-6abe3ebd-0da9-4432-ab86-1c676a216554 req-0edae54f-b4ce-4253-97c9-9ed66c896973 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:50.173345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-6abe3ebd-0da9-4432-ab86-1c676a216554 req-0edae54f-b4ce-4253-97c9-9ed66c896973 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:50.174539 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:50.184683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:50.185922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-6abe3ebd-0da9-4432-ab86-1c676a216554 req-0edae54f-b4ce-4253-97c9-9ed66c896973 service nova] Creating event network-changed:01db6eee-31a9-4f2e-be4c-31e4d1b8441b for instance c2351ed2-58ed-4953-b7a6-5c4773b2598a on hv-cinder-85124 Jul 27 20:40:50.186778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:50.189684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f9388d93-a447-461b-b57a-054e8e13ea69 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1406 microversion: 2.20 time: 0.216488 Jul 27 20:40:50.192063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-6abe3ebd-0da9-4432-ab86-1c676a216554 req-0edae54f-b4ce-4253-97c9-9ed66c896973 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032832 Jul 27 20:40:50.193436 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1007/1873] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:40:50.200308 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 867/1874] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:49 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:50.480186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-56f201e0-5fe5-4fb7-99f7-62aa07d52bc5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:50.480186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-56f201e0-5fe5-4fb7-99f7-62aa07d52bc5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:50.480829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-56f201e0-5fe5-4fb7-99f7-62aa07d52bc5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:50.481285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-56f201e0-5fe5-4fb7-99f7-62aa07d52bc5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:50.482056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-56f201e0-5fe5-4fb7-99f7-62aa07d52bc5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:50.482490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-56f201e0-5fe5-4fb7-99f7-62aa07d52bc5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:50.648817 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-56f201e0-5fe5-4fb7-99f7-62aa07d52bc5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:50.656796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-56f201e0-5fe5-4fb7-99f7-62aa07d52bc5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.187185 Jul 27 20:40:50.657378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1008/1875] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:50 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:51.031256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-26ae2e0b-a177-4681-b07e-ea3f65d5ebb7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:51.031873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-26ae2e0b-a177-4681-b07e-ea3f65d5ebb7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:51.039114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26ae2e0b-a177-4681-b07e-ea3f65d5ebb7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.039509 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26ae2e0b-a177-4681-b07e-ea3f65d5ebb7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:51.040272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26ae2e0b-a177-4681-b07e-ea3f65d5ebb7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.040818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26ae2e0b-a177-4681-b07e-ea3f65d5ebb7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:51.104004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-26ae2e0b-a177-4681-b07e-ea3f65d5ebb7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:51.112080 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-26ae2e0b-a177-4681-b07e-ea3f65d5ebb7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084889 Jul 27 20:40:51.112737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 868/1876] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:51 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:51.225642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:51.226225 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:51.232643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.233084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:51.233824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.234256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:51.363742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:51.371787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:51.373305 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:51.374387 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6953bd6b-4191-468b-8894-dee79be65c6a tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1406 microversion: 2.20 time: 0.153297 Jul 27 20:40:51.374943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1009/1877] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:51 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:51.678529 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fdebab13-91f4-4f58-9705-fe8c23335279 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:51.679067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fdebab13-91f4-4f58-9705-fe8c23335279 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:51.685247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fdebab13-91f4-4f58-9705-fe8c23335279 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.685703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fdebab13-91f4-4f58-9705-fe8c23335279 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:51.686463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fdebab13-91f4-4f58-9705-fe8c23335279 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.686904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fdebab13-91f4-4f58-9705-fe8c23335279 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:51.813905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fdebab13-91f4-4f58-9705-fe8c23335279 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:51.822296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fdebab13-91f4-4f58-9705-fe8c23335279 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147773 Jul 27 20:40:51.822870 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 869/1878] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:51 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:52.133313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-51f2987f-aa17-49df-9a89-35f81ed6e6e6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:52.133925 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-51f2987f-aa17-49df-9a89-35f81ed6e6e6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:52.140039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51f2987f-aa17-49df-9a89-35f81ed6e6e6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:52.140527 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51f2987f-aa17-49df-9a89-35f81ed6e6e6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:52.141295 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51f2987f-aa17-49df-9a89-35f81ed6e6e6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:52.141731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51f2987f-aa17-49df-9a89-35f81ed6e6e6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:52.207420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-51f2987f-aa17-49df-9a89-35f81ed6e6e6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:52.209699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=13,nova_cell1:DELETE=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:52.218675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-51f2987f-aa17-49df-9a89-35f81ed6e6e6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.089919 Jul 27 20:40:52.219287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1010/1879] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:52 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:52.396369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:52.396960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:52.403464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:52.403911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:52.404692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:52.405126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:52.423305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:52.531605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:52.539849 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:52.541388 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:52.542495 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a465e0f7-9385-4c53-8b2c-01314b753cb8 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1406 microversion: 2.20 time: 0.150141 Jul 27 20:40:52.543053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 870/1880] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:52 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:52.843077 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f7cb105a-b631-4b8e-99a7-03c51e646635 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:52.843781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f7cb105a-b631-4b8e-99a7-03c51e646635 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:52.851063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7cb105a-b631-4b8e-99a7-03c51e646635 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:52.851589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7cb105a-b631-4b8e-99a7-03c51e646635 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:52.852356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7cb105a-b631-4b8e-99a7-03c51e646635 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:52.852799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7cb105a-b631-4b8e-99a7-03c51e646635 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:52.981789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f7cb105a-b631-4b8e-99a7-03c51e646635 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:52.990227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f7cb105a-b631-4b8e-99a7-03c51e646635 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150502 Jul 27 20:40:52.990778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1011/1881] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:52 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:53.239275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f8bfd928-a8b8-480f-b30b-a87570d72ced tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:53.240514 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f8bfd928-a8b8-480f-b30b-a87570d72ced tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:53.242335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:53.247299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8bfd928-a8b8-480f-b30b-a87570d72ced tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:53.247745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8bfd928-a8b8-480f-b30b-a87570d72ced tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:53.248522 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8bfd928-a8b8-480f-b30b-a87570d72ced tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:53.248953 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8bfd928-a8b8-480f-b30b-a87570d72ced tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:53.312777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f8bfd928-a8b8-480f-b30b-a87570d72ced tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:53.320940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f8bfd928-a8b8-480f-b30b-a87570d72ced tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085557 Jul 27 20:40:53.321514 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 871/1882] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:53 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:53.565400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:53.565928 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:53.571808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:53.572255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:53.573041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:53.573476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:53.702255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:53.710518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:53.712023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:53.713143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b641da63-2e76-477e-9c03-9a361f027a08 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1406 microversion: 2.20 time: 0.151849 Jul 27 20:40:53.713703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1012/1883] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:53 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:54.012494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b066b9ab-8774-4b85-9c37-54a42e3901e6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:54.013113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b066b9ab-8774-4b85-9c37-54a42e3901e6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:54.019671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b066b9ab-8774-4b85-9c37-54a42e3901e6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.020119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b066b9ab-8774-4b85-9c37-54a42e3901e6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.021724 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b066b9ab-8774-4b85-9c37-54a42e3901e6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.022165 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b066b9ab-8774-4b85-9c37-54a42e3901e6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.150174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b066b9ab-8774-4b85-9c37-54a42e3901e6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:54.158058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b066b9ab-8774-4b85-9c37-54a42e3901e6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149466 Jul 27 20:40:54.158636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 872/1884] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:54 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:54.341388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-478971fd-fa8f-4e26-b2a9-af68d08df5a0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:54.341980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-478971fd-fa8f-4e26-b2a9-af68d08df5a0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:54.348363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-478971fd-fa8f-4e26-b2a9-af68d08df5a0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.348861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-478971fd-fa8f-4e26-b2a9-af68d08df5a0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.349622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-478971fd-fa8f-4e26-b2a9-af68d08df5a0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.350050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-478971fd-fa8f-4e26-b2a9-af68d08df5a0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.414484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-478971fd-fa8f-4e26-b2a9-af68d08df5a0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:54.422615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-478971fd-fa8f-4e26-b2a9-af68d08df5a0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085083 Jul 27 20:40:54.423193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1013/1885] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:54 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:54.735457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:54.736071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:54.747279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.747727 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.748521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.748965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.877518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:54.885380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:54.886930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:54.890078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c2a50cda-5b6b-4fa5-a1a2-d8b53ffb317d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1406 microversion: 2.20 time: 0.156494 Jul 27 20:40:54.890078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 873/1886] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:54 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:55.064766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-b8ecf463-f99c-48b7-aade-75e5f08092a8 req-ce6758ec-78b2-4cf9-9082-f155f836dffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2351ed2-58ed-4953-b7a6-5c4773b2598a", "name": "network-vif-plugged", "status": "completed", "tag": "01db6eee-31a9-4f2e-be4c-31e4d1b8441b"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:40:55.075538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-b8ecf463-f99c-48b7-aade-75e5f08092a8 req-ce6758ec-78b2-4cf9-9082-f155f836dffe service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.087714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-b8ecf463-f99c-48b7-aade-75e5f08092a8 req-ce6758ec-78b2-4cf9-9082-f155f836dffe service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.087714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-b8ecf463-f99c-48b7-aade-75e5f08092a8 req-ce6758ec-78b2-4cf9-9082-f155f836dffe service nova] Creating event network-vif-plugged:01db6eee-31a9-4f2e-be4c-31e4d1b8441b for instance c2351ed2-58ed-4953-b7a6-5c4773b2598a on hv-cinder-85124 Jul 27 20:40:55.092477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-b8ecf463-f99c-48b7-aade-75e5f08092a8 req-ce6758ec-78b2-4cf9-9082-f155f836dffe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091572 Jul 27 20:40:55.093503 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1014/1887] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:40:55.179084 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e7f31c14-b70a-415f-9ec3-ef3b0365f8c8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:55.179731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e7f31c14-b70a-415f-9ec3-ef3b0365f8c8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:55.186194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7f31c14-b70a-415f-9ec3-ef3b0365f8c8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.186651 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7f31c14-b70a-415f-9ec3-ef3b0365f8c8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.187418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7f31c14-b70a-415f-9ec3-ef3b0365f8c8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.187855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7f31c14-b70a-415f-9ec3-ef3b0365f8c8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.326061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7f31c14-b70a-415f-9ec3-ef3b0365f8c8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:55.335420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e7f31c14-b70a-415f-9ec3-ef3b0365f8c8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.160214 Jul 27 20:40:55.341000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 874/1888] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:55 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:55.444656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ab3d09e0-b520-4308-9674-9bd7afe338db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:55.445366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ab3d09e0-b520-4308-9674-9bd7afe338db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:55.451582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab3d09e0-b520-4308-9674-9bd7afe338db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.452035 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab3d09e0-b520-4308-9674-9bd7afe338db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.452828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab3d09e0-b520-4308-9674-9bd7afe338db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.453266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ab3d09e0-b520-4308-9674-9bd7afe338db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.535359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ab3d09e0-b520-4308-9674-9bd7afe338db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:55.543317 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ab3d09e0-b520-4308-9674-9bd7afe338db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.103432 Jul 27 20:40:55.543890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1015/1889] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:55 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:55.910585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:55.911154 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:55.917188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.917638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.918398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.918832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:56.044198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:56.052574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:56.054099 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:56.055480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ecad442e-c563-450f-adf4-ca763a011394 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1406 microversion: 2.20 time: 0.148689 Jul 27 20:40:56.056042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 875/1890] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:55 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:56.357022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-016a874d-427e-48c6-be83-477e1d8edd06 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:56.357635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-016a874d-427e-48c6-be83-477e1d8edd06 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:56.364089 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-016a874d-427e-48c6-be83-477e1d8edd06 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:56.365163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-016a874d-427e-48c6-be83-477e1d8edd06 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:56.365922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-016a874d-427e-48c6-be83-477e1d8edd06 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:56.366355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-016a874d-427e-48c6-be83-477e1d8edd06 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:56.455536 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:56.495684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-016a874d-427e-48c6-be83-477e1d8edd06 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:56.503506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-016a874d-427e-48c6-be83-477e1d8edd06 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150364 Jul 27 20:40:56.504075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1016/1891] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:56 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:56.563725 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6dfbc906-1c12-4809-86ed-34ae238fe4c6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:56.564347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6dfbc906-1c12-4809-86ed-34ae238fe4c6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:56.570881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6dfbc906-1c12-4809-86ed-34ae238fe4c6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:56.571335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6dfbc906-1c12-4809-86ed-34ae238fe4c6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:56.572097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6dfbc906-1c12-4809-86ed-34ae238fe4c6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:56.572578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6dfbc906-1c12-4809-86ed-34ae238fe4c6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:56.633392 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6dfbc906-1c12-4809-86ed-34ae238fe4c6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:56.641146 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6dfbc906-1c12-4809-86ed-34ae238fe4c6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081264 Jul 27 20:40:56.641710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 876/1892] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:56 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:57.078776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:57.079386 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:57.081254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=8 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:57.086165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.086619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.087377 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.087815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.219997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:57.228468 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:57.229989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:57.231116 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-96679479-5a32-4503-a61e-e8e3d4d152b1 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1406 microversion: 2.20 time: 0.156271 Jul 27 20:40:57.231802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1017/1893] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:57 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:57.525300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-925f1bc5-0580-47fb-9618-1c7303f9b2dc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:57.525919 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-925f1bc5-0580-47fb-9618-1c7303f9b2dc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:57.531932 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-925f1bc5-0580-47fb-9618-1c7303f9b2dc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.532408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-925f1bc5-0580-47fb-9618-1c7303f9b2dc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.533161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-925f1bc5-0580-47fb-9618-1c7303f9b2dc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.533598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-925f1bc5-0580-47fb-9618-1c7303f9b2dc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.659735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-925f1bc5-0580-47fb-9618-1c7303f9b2dc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:57.662032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-967462fd-4588-437f-80ed-435bd3632ebd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:57.662642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-967462fd-4588-437f-80ed-435bd3632ebd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:57.667782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-925f1bc5-0580-47fb-9618-1c7303f9b2dc tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147087 Jul 27 20:40:57.668351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 877/1894] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:57 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:57.668998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-967462fd-4588-437f-80ed-435bd3632ebd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.669448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-967462fd-4588-437f-80ed-435bd3632ebd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.670205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-967462fd-4588-437f-80ed-435bd3632ebd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.670635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-967462fd-4588-437f-80ed-435bd3632ebd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.730164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-967462fd-4588-437f-80ed-435bd3632ebd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:57.737920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-967462fd-4588-437f-80ed-435bd3632ebd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.079672 Jul 27 20:40:57.738489 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1018/1895] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:57 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:58.253597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:58.254183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:58.261731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.262182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.262929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.263358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.393783 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:58.401815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:58.403638 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:58.404860 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e7e32f42-b600-48d7-a299-76da42e95541 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1598 microversion: 2.20 time: 0.155210 Jul 27 20:40:58.405427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 878/1896] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:58 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:58.430535 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-48efea91-dac9-4a5a-8bf7-021e07ee481c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:58.431057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-48efea91-dac9-4a5a-8bf7-021e07ee481c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:58.437137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48efea91-dac9-4a5a-8bf7-021e07ee481c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.437582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48efea91-dac9-4a5a-8bf7-021e07ee481c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.438329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48efea91-dac9-4a5a-8bf7-021e07ee481c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.438758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48efea91-dac9-4a5a-8bf7-021e07ee481c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.515261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-48efea91-dac9-4a5a-8bf7-021e07ee481c tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089333 Jul 27 20:40:58.515864 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1019/1897] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Jul 27 20:40:58 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:40:58.688882 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9452a7bd-51ec-42c1-bb29-2a3617f6cbd8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:58.689496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9452a7bd-51ec-42c1-bb29-2a3617f6cbd8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:58.695927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9452a7bd-51ec-42c1-bb29-2a3617f6cbd8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.696399 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9452a7bd-51ec-42c1-bb29-2a3617f6cbd8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.697163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9452a7bd-51ec-42c1-bb29-2a3617f6cbd8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.697598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9452a7bd-51ec-42c1-bb29-2a3617f6cbd8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.759090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-30f2cd0a-805e-43f8-bac6-5150d7ac7b35 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:58.759877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-30f2cd0a-805e-43f8-bac6-5150d7ac7b35 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:58.765891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30f2cd0a-805e-43f8-bac6-5150d7ac7b35 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.766273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30f2cd0a-805e-43f8-bac6-5150d7ac7b35 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.767021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30f2cd0a-805e-43f8-bac6-5150d7ac7b35 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.767445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30f2cd0a-805e-43f8-bac6-5150d7ac7b35 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.877585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-30f2cd0a-805e-43f8-bac6-5150d7ac7b35 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:58.885678 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-30f2cd0a-805e-43f8-bac6-5150d7ac7b35 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.130891 Jul 27 20:40:58.886279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1020/1898] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:58 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:58.987738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9452a7bd-51ec-42c1-bb29-2a3617f6cbd8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:58.996064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9452a7bd-51ec-42c1-bb29-2a3617f6cbd8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.310984 Jul 27 20:40:58.996671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 879/1899] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:58 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:59.860707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-0478434f-a8cb-4bc5-bdde-4277f9fd16a2 req-41b7cc41-5b9e-496f-84d2-a5f40f2c3c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2351ed2-58ed-4953-b7a6-5c4773b2598a", "tag": "01db6eee-31a9-4f2e-be4c-31e4d1b8441b"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:40:59.871348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-0478434f-a8cb-4bc5-bdde-4277f9fd16a2 req-41b7cc41-5b9e-496f-84d2-a5f40f2c3c5c service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:59.871788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-0478434f-a8cb-4bc5-bdde-4277f9fd16a2 req-41b7cc41-5b9e-496f-84d2-a5f40f2c3c5c service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:59.882711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-0478434f-a8cb-4bc5-bdde-4277f9fd16a2 req-41b7cc41-5b9e-496f-84d2-a5f40f2c3c5c service nova] Creating event network-changed:01db6eee-31a9-4f2e-be4c-31e4d1b8441b for instance c2351ed2-58ed-4953-b7a6-5c4773b2598a on hv-cinder-85124 Jul 27 20:40:59.887967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-0478434f-a8cb-4bc5-bdde-4277f9fd16a2 req-41b7cc41-5b9e-496f-84d2-a5f40f2c3c5c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030874 Jul 27 20:40:59.888690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1021/1900] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:40:59.908855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8b40f567-9b11-46f8-87fe-8fc5cf60776e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:59.909471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8b40f567-9b11-46f8-87fe-8fc5cf60776e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:59.916447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b40f567-9b11-46f8-87fe-8fc5cf60776e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:59.916896 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b40f567-9b11-46f8-87fe-8fc5cf60776e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:59.917768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b40f567-9b11-46f8-87fe-8fc5cf60776e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:59.918208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b40f567-9b11-46f8-87fe-8fc5cf60776e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:00.000793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8b40f567-9b11-46f8-87fe-8fc5cf60776e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:00.008745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8b40f567-9b11-46f8-87fe-8fc5cf60776e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.103666 Jul 27 20:41:00.009331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 880/1901] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:59 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:00.017919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e979136c-76a7-4f0b-b3c4-4b5f04430605 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:00.019083 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e979136c-76a7-4f0b-b3c4-4b5f04430605 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:00.026381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e979136c-76a7-4f0b-b3c4-4b5f04430605 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:00.027125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e979136c-76a7-4f0b-b3c4-4b5f04430605 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:00.027995 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e979136c-76a7-4f0b-b3c4-4b5f04430605 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:00.028539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e979136c-76a7-4f0b-b3c4-4b5f04430605 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:00.231795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e979136c-76a7-4f0b-b3c4-4b5f04430605 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:00.240032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e979136c-76a7-4f0b-b3c4-4b5f04430605 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.226924 Jul 27 20:41:00.241949 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1022/1902] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:00 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:01.028957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1728cf02-a3e0-4582-aba6-0ddb19518fe0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:01.029725 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1728cf02-a3e0-4582-aba6-0ddb19518fe0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:01.036680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1728cf02-a3e0-4582-aba6-0ddb19518fe0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:01.037157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1728cf02-a3e0-4582-aba6-0ddb19518fe0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:01.037972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1728cf02-a3e0-4582-aba6-0ddb19518fe0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:01.038315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1728cf02-a3e0-4582-aba6-0ddb19518fe0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:01.100291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1728cf02-a3e0-4582-aba6-0ddb19518fe0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:01.108305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1728cf02-a3e0-4582-aba6-0ddb19518fe0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083196 Jul 27 20:41:01.108908 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 881/1903] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:01 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:01.262701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a75e7e5b-6201-4e7e-9b8b-5a1aba4b48c4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:01.263236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a75e7e5b-6201-4e7e-9b8b-5a1aba4b48c4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:01.269698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a75e7e5b-6201-4e7e-9b8b-5a1aba4b48c4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:01.270145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a75e7e5b-6201-4e7e-9b8b-5a1aba4b48c4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:01.270899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a75e7e5b-6201-4e7e-9b8b-5a1aba4b48c4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:01.271328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a75e7e5b-6201-4e7e-9b8b-5a1aba4b48c4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:01.400933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a75e7e5b-6201-4e7e-9b8b-5a1aba4b48c4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:01.408886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a75e7e5b-6201-4e7e-9b8b-5a1aba4b48c4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150098 Jul 27 20:41:01.413405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1023/1904] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:01 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:02.129779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-32ff2c6f-fca9-4729-9fd2-4cc6f45d0f1e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:02.130854 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-32ff2c6f-fca9-4729-9fd2-4cc6f45d0f1e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:02.137314 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-32ff2c6f-fca9-4729-9fd2-4cc6f45d0f1e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:02.137767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-32ff2c6f-fca9-4729-9fd2-4cc6f45d0f1e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:02.138530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-32ff2c6f-fca9-4729-9fd2-4cc6f45d0f1e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:02.138970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-32ff2c6f-fca9-4729-9fd2-4cc6f45d0f1e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:02.198678 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-32ff2c6f-fca9-4729-9fd2-4cc6f45d0f1e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:02.206636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-32ff2c6f-fca9-4729-9fd2-4cc6f45d0f1e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080830 Jul 27 20:41:02.207207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 882/1905] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:02 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:02.433230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9dcdf740-88a7-4716-a8ae-139737cb0e66 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:02.434836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9dcdf740-88a7-4716-a8ae-139737cb0e66 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:02.441307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9dcdf740-88a7-4716-a8ae-139737cb0e66 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:02.441781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9dcdf740-88a7-4716-a8ae-139737cb0e66 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:02.443026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9dcdf740-88a7-4716-a8ae-139737cb0e66 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:02.443455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9dcdf740-88a7-4716-a8ae-139737cb0e66 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:02.567064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9dcdf740-88a7-4716-a8ae-139737cb0e66 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:02.575456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9dcdf740-88a7-4716-a8ae-139737cb0e66 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146234 Jul 27 20:41:02.576026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1024/1906] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:02 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:03.228081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0056761d-2765-41c5-84eb-2b79db59d5f8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:03.228721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0056761d-2765-41c5-84eb-2b79db59d5f8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:03.231105 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:03.235825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0056761d-2765-41c5-84eb-2b79db59d5f8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:03.236275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0056761d-2765-41c5-84eb-2b79db59d5f8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:03.237067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0056761d-2765-41c5-84eb-2b79db59d5f8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:03.237500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0056761d-2765-41c5-84eb-2b79db59d5f8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:03.302243 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0056761d-2765-41c5-84eb-2b79db59d5f8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:03.310148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0056761d-2765-41c5-84eb-2b79db59d5f8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086582 Jul 27 20:41:03.310707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 883/1907] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:03 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:03.596788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-343b45c6-2aa9-46ce-a520-bf39d1ec6b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:03.597352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-343b45c6-2aa9-46ce-a520-bf39d1ec6b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:03.603698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-343b45c6-2aa9-46ce-a520-bf39d1ec6b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:03.604137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-343b45c6-2aa9-46ce-a520-bf39d1ec6b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:03.604919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-343b45c6-2aa9-46ce-a520-bf39d1ec6b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:03.605342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-343b45c6-2aa9-46ce-a520-bf39d1ec6b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:03.730270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-343b45c6-2aa9-46ce-a520-bf39d1ec6b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:03.738054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-343b45c6-2aa9-46ce-a520-bf39d1ec6b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145248 Jul 27 20:41:03.738622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1025/1908] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:03 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:04.330817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-503f9dc7-7d99-4f4f-a6b7-ac2b674ad02b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:04.331455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-503f9dc7-7d99-4f4f-a6b7-ac2b674ad02b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:04.338944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-503f9dc7-7d99-4f4f-a6b7-ac2b674ad02b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:04.339386 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-503f9dc7-7d99-4f4f-a6b7-ac2b674ad02b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:04.340137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-503f9dc7-7d99-4f4f-a6b7-ac2b674ad02b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:04.340595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-503f9dc7-7d99-4f4f-a6b7-ac2b674ad02b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:04.401253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-503f9dc7-7d99-4f4f-a6b7-ac2b674ad02b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:04.408960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-503f9dc7-7d99-4f4f-a6b7-ac2b674ad02b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082036 Jul 27 20:41:04.409524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 884/1909] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:04 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:04.759082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d98c7553-9040-45d7-93fe-5ac824ec6957 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:04.759692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d98c7553-9040-45d7-93fe-5ac824ec6957 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:04.766202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d98c7553-9040-45d7-93fe-5ac824ec6957 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:04.766649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d98c7553-9040-45d7-93fe-5ac824ec6957 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:04.767408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d98c7553-9040-45d7-93fe-5ac824ec6957 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:04.767843 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d98c7553-9040-45d7-93fe-5ac824ec6957 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:04.900245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d98c7553-9040-45d7-93fe-5ac824ec6957 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:04.908687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d98c7553-9040-45d7-93fe-5ac824ec6957 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153465 Jul 27 20:41:04.909478 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1026/1910] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:04 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:05.429991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-271cc9a5-b95b-4381-97d8-d4d3d806b309 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:05.430641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-271cc9a5-b95b-4381-97d8-d4d3d806b309 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:05.437413 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-271cc9a5-b95b-4381-97d8-d4d3d806b309 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:05.437858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-271cc9a5-b95b-4381-97d8-d4d3d806b309 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:05.438611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-271cc9a5-b95b-4381-97d8-d4d3d806b309 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:05.439044 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-271cc9a5-b95b-4381-97d8-d4d3d806b309 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:05.499823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-271cc9a5-b95b-4381-97d8-d4d3d806b309 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:05.508209 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-271cc9a5-b95b-4381-97d8-d4d3d806b309 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082093 Jul 27 20:41:05.508797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 885/1911] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:05 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:05.935086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-de4f9ae8-d98b-48ec-ae7d-abbd1f7025db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:05.935700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-de4f9ae8-d98b-48ec-ae7d-abbd1f7025db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:05.942187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de4f9ae8-d98b-48ec-ae7d-abbd1f7025db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:05.942640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de4f9ae8-d98b-48ec-ae7d-abbd1f7025db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:05.943397 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de4f9ae8-d98b-48ec-ae7d-abbd1f7025db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:05.943840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-de4f9ae8-d98b-48ec-ae7d-abbd1f7025db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:06.068581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-de4f9ae8-d98b-48ec-ae7d-abbd1f7025db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:06.076472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-de4f9ae8-d98b-48ec-ae7d-abbd1f7025db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145233 Jul 27 20:41:06.077050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1027/1912] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:05 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:06.528890 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-90041330-9ec0-42ff-8577-8e663fe597d0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:06.529511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-90041330-9ec0-42ff-8577-8e663fe597d0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:06.536702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90041330-9ec0-42ff-8577-8e663fe597d0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:06.537161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90041330-9ec0-42ff-8577-8e663fe597d0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:06.537921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90041330-9ec0-42ff-8577-8e663fe597d0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:06.538362 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90041330-9ec0-42ff-8577-8e663fe597d0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:06.603173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90041330-9ec0-42ff-8577-8e663fe597d0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:06.611512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-90041330-9ec0-42ff-8577-8e663fe597d0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086592 Jul 27 20:41:06.612090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 886/1913] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:06 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:07.096795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8f06029c-2062-4908-8bad-cc2708874d7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:07.097410 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8f06029c-2062-4908-8bad-cc2708874d7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:07.103925 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f06029c-2062-4908-8bad-cc2708874d7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:07.104369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f06029c-2062-4908-8bad-cc2708874d7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:07.105214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f06029c-2062-4908-8bad-cc2708874d7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:07.105645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f06029c-2062-4908-8bad-cc2708874d7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:07.232195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8f06029c-2062-4908-8bad-cc2708874d7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:07.240000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8f06029c-2062-4908-8bad-cc2708874d7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147090 Jul 27 20:41:07.241103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1028/1914] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:07 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:07.632074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1cfa3b74-c2af-43f8-8e45-8f9ab483a2d5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:07.632733 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1cfa3b74-c2af-43f8-8e45-8f9ab483a2d5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:07.639149 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1cfa3b74-c2af-43f8-8e45-8f9ab483a2d5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:07.639601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1cfa3b74-c2af-43f8-8e45-8f9ab483a2d5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:07.640363 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1cfa3b74-c2af-43f8-8e45-8f9ab483a2d5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:07.640828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1cfa3b74-c2af-43f8-8e45-8f9ab483a2d5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:07.644762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:07.700810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1cfa3b74-c2af-43f8-8e45-8f9ab483a2d5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:07.708577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1cfa3b74-c2af-43f8-8e45-8f9ab483a2d5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080464 Jul 27 20:41:07.709666 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 887/1915] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:07 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:08.261876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e5ddf85-9dd0-45fd-a0b6-53738b1a67d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:08.262565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7e5ddf85-9dd0-45fd-a0b6-53738b1a67d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:08.269059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e5ddf85-9dd0-45fd-a0b6-53738b1a67d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:08.269503 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e5ddf85-9dd0-45fd-a0b6-53738b1a67d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:08.270253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e5ddf85-9dd0-45fd-a0b6-53738b1a67d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:08.270683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e5ddf85-9dd0-45fd-a0b6-53738b1a67d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:08.273309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:08.404506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7e5ddf85-9dd0-45fd-a0b6-53738b1a67d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:08.412975 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7e5ddf85-9dd0-45fd-a0b6-53738b1a67d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154432 Jul 27 20:41:08.413539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1029/1916] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:08 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:08.730144 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5e372d70-91e5-470d-a7c2-40f90cf3c4dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:08.730754 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5e372d70-91e5-470d-a7c2-40f90cf3c4dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:08.737199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e372d70-91e5-470d-a7c2-40f90cf3c4dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:08.737651 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e372d70-91e5-470d-a7c2-40f90cf3c4dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:08.738405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e372d70-91e5-470d-a7c2-40f90cf3c4dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:08.738839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e372d70-91e5-470d-a7c2-40f90cf3c4dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:08.798927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5e372d70-91e5-470d-a7c2-40f90cf3c4dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:08.806776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5e372d70-91e5-470d-a7c2-40f90cf3c4dd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080520 Jul 27 20:41:08.807742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 888/1917] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:08 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:09.436063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ca0f4d96-33ae-413e-b086-59cca6654aa2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:09.436696 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ca0f4d96-33ae-413e-b086-59cca6654aa2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:09.443149 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca0f4d96-33ae-413e-b086-59cca6654aa2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:09.444245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca0f4d96-33ae-413e-b086-59cca6654aa2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:09.445021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca0f4d96-33ae-413e-b086-59cca6654aa2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:09.445446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca0f4d96-33ae-413e-b086-59cca6654aa2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:09.571836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ca0f4d96-33ae-413e-b086-59cca6654aa2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:09.579855 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ca0f4d96-33ae-413e-b086-59cca6654aa2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148959 Jul 27 20:41:09.580460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1030/1918] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:09 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:09.827545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d3a275a6-01a3-46cf-970f-e723ac7f9ba5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:09.828153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d3a275a6-01a3-46cf-970f-e723ac7f9ba5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:09.834583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d3a275a6-01a3-46cf-970f-e723ac7f9ba5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:09.835023 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d3a275a6-01a3-46cf-970f-e723ac7f9ba5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:09.835793 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d3a275a6-01a3-46cf-970f-e723ac7f9ba5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:09.836218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d3a275a6-01a3-46cf-970f-e723ac7f9ba5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:09.899839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d3a275a6-01a3-46cf-970f-e723ac7f9ba5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:09.907620 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d3a275a6-01a3-46cf-970f-e723ac7f9ba5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083981 Jul 27 20:41:09.908175 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 889/1919] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:09 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:10.601470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-39b6c712-7824-46d3-81a3-ef8400aa0465 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:10.602021 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39b6c712-7824-46d3-81a3-ef8400aa0465 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:10.605797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:10.609247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b6c712-7824-46d3-81a3-ef8400aa0465 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:10.609698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b6c712-7824-46d3-81a3-ef8400aa0465 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:10.610457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b6c712-7824-46d3-81a3-ef8400aa0465 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:10.610891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b6c712-7824-46d3-81a3-ef8400aa0465 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:10.743154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-39b6c712-7824-46d3-81a3-ef8400aa0465 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:10.751816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-39b6c712-7824-46d3-81a3-ef8400aa0465 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154284 Jul 27 20:41:10.752415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1031/1920] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:10 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:10.929218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-57eec739-fd9f-44a3-b8f4-4f09fc3b42b1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:10.929836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-57eec739-fd9f-44a3-b8f4-4f09fc3b42b1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:10.936704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57eec739-fd9f-44a3-b8f4-4f09fc3b42b1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:10.937156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57eec739-fd9f-44a3-b8f4-4f09fc3b42b1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:10.937971 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57eec739-fd9f-44a3-b8f4-4f09fc3b42b1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:10.938404 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57eec739-fd9f-44a3-b8f4-4f09fc3b42b1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:10.999923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-57eec739-fd9f-44a3-b8f4-4f09fc3b42b1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:11.008618 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-57eec739-fd9f-44a3-b8f4-4f09fc3b42b1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083795 Jul 27 20:41:11.009188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 890/1921] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:10 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:11.774236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3b5550af-0f84-437f-90bb-706cd17c575f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:11.774839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3b5550af-0f84-437f-90bb-706cd17c575f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:11.781148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b5550af-0f84-437f-90bb-706cd17c575f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:11.781590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b5550af-0f84-437f-90bb-706cd17c575f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:11.782338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b5550af-0f84-437f-90bb-706cd17c575f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:11.782766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b5550af-0f84-437f-90bb-706cd17c575f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:11.913239 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3b5550af-0f84-437f-90bb-706cd17c575f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:11.921023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3b5550af-0f84-437f-90bb-706cd17c575f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151525 Jul 27 20:41:11.921585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1032/1922] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:11 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:12.029140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d533d0f5-98c8-41a7-82aa-754f6d5456bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:12.029800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d533d0f5-98c8-41a7-82aa-754f6d5456bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:12.036255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d533d0f5-98c8-41a7-82aa-754f6d5456bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:12.036748 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d533d0f5-98c8-41a7-82aa-754f6d5456bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:12.037493 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d533d0f5-98c8-41a7-82aa-754f6d5456bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:12.037925 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d533d0f5-98c8-41a7-82aa-754f6d5456bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:12.098825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d533d0f5-98c8-41a7-82aa-754f6d5456bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:12.106702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d533d0f5-98c8-41a7-82aa-754f6d5456bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081449 Jul 27 20:41:12.107270 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 891/1923] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:12 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:12.942162 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-17845c64-b49f-4a9c-a402-51f0c7e8166c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:12.942779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-17845c64-b49f-4a9c-a402-51f0c7e8166c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:12.949265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17845c64-b49f-4a9c-a402-51f0c7e8166c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:12.949715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17845c64-b49f-4a9c-a402-51f0c7e8166c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:12.950469 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17845c64-b49f-4a9c-a402-51f0c7e8166c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:12.950903 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17845c64-b49f-4a9c-a402-51f0c7e8166c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:13.077349 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-17845c64-b49f-4a9c-a402-51f0c7e8166c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:13.085947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-17845c64-b49f-4a9c-a402-51f0c7e8166c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147619 Jul 27 20:41:13.086524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1033/1924] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:12 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:13.127011 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-888a2462-ef9d-4272-9799-2c5f81363a97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:13.127627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-888a2462-ef9d-4272-9799-2c5f81363a97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:13.134076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-888a2462-ef9d-4272-9799-2c5f81363a97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:13.134526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-888a2462-ef9d-4272-9799-2c5f81363a97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:13.135320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-888a2462-ef9d-4272-9799-2c5f81363a97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:13.135753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-888a2462-ef9d-4272-9799-2c5f81363a97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:13.201941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-888a2462-ef9d-4272-9799-2c5f81363a97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:13.210362 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-888a2462-ef9d-4272-9799-2c5f81363a97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.087262 Jul 27 20:41:13.210959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 892/1925] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:13 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:14.107066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-216e99a5-8809-4278-b8a6-fc29aa5088ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:14.107805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-216e99a5-8809-4278-b8a6-fc29aa5088ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:14.114588 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-216e99a5-8809-4278-b8a6-fc29aa5088ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:14.115921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-216e99a5-8809-4278-b8a6-fc29aa5088ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:14.116560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-216e99a5-8809-4278-b8a6-fc29aa5088ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:14.116999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-216e99a5-8809-4278-b8a6-fc29aa5088ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:14.231380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6e19a328-0e81-4452-9b17-6d285f4e0857 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:14.231992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6e19a328-0e81-4452-9b17-6d285f4e0857 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:14.238401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e19a328-0e81-4452-9b17-6d285f4e0857 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:14.238847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e19a328-0e81-4452-9b17-6d285f4e0857 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:14.239610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e19a328-0e81-4452-9b17-6d285f4e0857 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:14.240040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6e19a328-0e81-4452-9b17-6d285f4e0857 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:14.246066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-216e99a5-8809-4278-b8a6-fc29aa5088ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:14.261325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-216e99a5-8809-4278-b8a6-fc29aa5088ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.158113 Jul 27 20:41:14.261921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1034/1926] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:14 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:14.300879 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6e19a328-0e81-4452-9b17-6d285f4e0857 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:14.309297 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6e19a328-0e81-4452-9b17-6d285f4e0857 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081926 Jul 27 20:41:14.309859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 893/1927] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:14 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:15.281520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3e4f3b24-44c5-4832-9170-5bd732f22a63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:15.285222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3e4f3b24-44c5-4832-9170-5bd732f22a63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:15.289375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e4f3b24-44c5-4832-9170-5bd732f22a63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:15.289818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e4f3b24-44c5-4832-9170-5bd732f22a63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:15.290570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e4f3b24-44c5-4832-9170-5bd732f22a63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:15.290998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e4f3b24-44c5-4832-9170-5bd732f22a63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:15.329650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-548a5399-9675-4f32-8480-24ddd0fd1255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:15.330282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-548a5399-9675-4f32-8480-24ddd0fd1255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:15.338332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-548a5399-9675-4f32-8480-24ddd0fd1255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:15.338790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-548a5399-9675-4f32-8480-24ddd0fd1255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:15.339567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-548a5399-9675-4f32-8480-24ddd0fd1255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:15.340010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-548a5399-9675-4f32-8480-24ddd0fd1255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:15.414744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-548a5399-9675-4f32-8480-24ddd0fd1255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:15.422820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-548a5399-9675-4f32-8480-24ddd0fd1255 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.097023 Jul 27 20:41:15.423407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 894/1928] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:15 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:15.443560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3e4f3b24-44c5-4832-9170-5bd732f22a63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:15.451656 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3e4f3b24-44c5-4832-9170-5bd732f22a63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.174023 Jul 27 20:41:15.452220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1035/1929] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:15 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:16.443103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-78b35b28-98ad-4acc-8ea7-885625136e15 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:16.443748 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-78b35b28-98ad-4acc-8ea7-885625136e15 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:16.450306 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78b35b28-98ad-4acc-8ea7-885625136e15 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:16.450752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78b35b28-98ad-4acc-8ea7-885625136e15 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:16.451512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78b35b28-98ad-4acc-8ea7-885625136e15 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:16.451956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78b35b28-98ad-4acc-8ea7-885625136e15 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:16.477338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0be7fdfd-e415-483d-92d8-7d2ca4cf2a20 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:16.477958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0be7fdfd-e415-483d-92d8-7d2ca4cf2a20 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:16.484481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0be7fdfd-e415-483d-92d8-7d2ca4cf2a20 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:16.484937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0be7fdfd-e415-483d-92d8-7d2ca4cf2a20 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:16.485701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0be7fdfd-e415-483d-92d8-7d2ca4cf2a20 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:16.486136 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0be7fdfd-e415-483d-92d8-7d2ca4cf2a20 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:16.513295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-78b35b28-98ad-4acc-8ea7-885625136e15 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:16.521464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-78b35b28-98ad-4acc-8ea7-885625136e15 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082158 Jul 27 20:41:16.521987 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 895/1930] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:16 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:16.613260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0be7fdfd-e415-483d-92d8-7d2ca4cf2a20 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:16.623264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0be7fdfd-e415-483d-92d8-7d2ca4cf2a20 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150347 Jul 27 20:41:16.623837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1036/1931] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:16 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:17.541990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bafef63b-8163-4ab9-b290-1c152a8d853e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:17.542586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bafef63b-8163-4ab9-b290-1c152a8d853e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:17.548961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bafef63b-8163-4ab9-b290-1c152a8d853e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:17.549429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bafef63b-8163-4ab9-b290-1c152a8d853e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:17.550174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bafef63b-8163-4ab9-b290-1c152a8d853e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:17.550599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bafef63b-8163-4ab9-b290-1c152a8d853e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:17.614145 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bafef63b-8163-4ab9-b290-1c152a8d853e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:17.622833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bafef63b-8163-4ab9-b290-1c152a8d853e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084786 Jul 27 20:41:17.623420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 896/1932] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:17 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:17.644459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ac13bc3f-147f-4d34-8b13-0f2ba96447c2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:17.645080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ac13bc3f-147f-4d34-8b13-0f2ba96447c2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:17.651594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac13bc3f-147f-4d34-8b13-0f2ba96447c2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:17.652050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac13bc3f-147f-4d34-8b13-0f2ba96447c2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:17.652838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac13bc3f-147f-4d34-8b13-0f2ba96447c2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:17.653273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ac13bc3f-147f-4d34-8b13-0f2ba96447c2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:17.777737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ac13bc3f-147f-4d34-8b13-0f2ba96447c2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:17.785646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ac13bc3f-147f-4d34-8b13-0f2ba96447c2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145127 Jul 27 20:41:17.786221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1037/1933] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:17 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:18.754642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-523af347-f113-48ec-b86a-968a59345b10 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:18.755328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-523af347-f113-48ec-b86a-968a59345b10 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:18.761850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-523af347-f113-48ec-b86a-968a59345b10 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:18.762301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-523af347-f113-48ec-b86a-968a59345b10 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:18.763066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-523af347-f113-48ec-b86a-968a59345b10 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:18.763505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-523af347-f113-48ec-b86a-968a59345b10 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:18.824334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-523af347-f113-48ec-b86a-968a59345b10 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:18.832519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-523af347-f113-48ec-b86a-968a59345b10 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.193222 Jul 27 20:41:18.833093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 897/1934] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:18 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:18.915716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7c7c7461-cf1c-4cc5-9e7b-01e1b85d114f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:18.916332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7c7c7461-cf1c-4cc5-9e7b-01e1b85d114f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:18.922394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c7c7461-cf1c-4cc5-9e7b-01e1b85d114f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:18.922852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c7c7461-cf1c-4cc5-9e7b-01e1b85d114f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:18.923614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c7c7461-cf1c-4cc5-9e7b-01e1b85d114f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:18.924049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c7c7461-cf1c-4cc5-9e7b-01e1b85d114f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:19.056194 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7c7c7461-cf1c-4cc5-9e7b-01e1b85d114f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:19.064167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7c7c7461-cf1c-4cc5-9e7b-01e1b85d114f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.260987 Jul 27 20:41:19.064948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1038/1935] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:18 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:19.854220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-624dd3ca-a16c-4f65-87ce-9bd9d31a40ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:19.854828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-624dd3ca-a16c-4f65-87ce-9bd9d31a40ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:19.861307 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-624dd3ca-a16c-4f65-87ce-9bd9d31a40ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:19.861754 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-624dd3ca-a16c-4f65-87ce-9bd9d31a40ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:19.862505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-624dd3ca-a16c-4f65-87ce-9bd9d31a40ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:19.862939 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-624dd3ca-a16c-4f65-87ce-9bd9d31a40ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:19.922849 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-624dd3ca-a16c-4f65-87ce-9bd9d31a40ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:19.930623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-624dd3ca-a16c-4f65-87ce-9bd9d31a40ea tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080895 Jul 27 20:41:19.931189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 898/1936] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:19 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:20.086000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2409f37a-cd30-4a77-9222-920fa19e7fd0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:20.086645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2409f37a-cd30-4a77-9222-920fa19e7fd0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:20.093157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2409f37a-cd30-4a77-9222-920fa19e7fd0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:20.093608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2409f37a-cd30-4a77-9222-920fa19e7fd0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:20.094374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2409f37a-cd30-4a77-9222-920fa19e7fd0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:20.094812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2409f37a-cd30-4a77-9222-920fa19e7fd0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:20.222158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2409f37a-cd30-4a77-9222-920fa19e7fd0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:20.230037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2409f37a-cd30-4a77-9222-920fa19e7fd0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148547 Jul 27 20:41:20.230609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1039/1937] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:20 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:20.955114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eae8e911-109b-4a54-bc60-d0b77ef837c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:20.955652 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eae8e911-109b-4a54-bc60-d0b77ef837c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:20.962403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eae8e911-109b-4a54-bc60-d0b77ef837c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:20.962858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eae8e911-109b-4a54-bc60-d0b77ef837c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:20.963615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eae8e911-109b-4a54-bc60-d0b77ef837c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:20.964052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eae8e911-109b-4a54-bc60-d0b77ef837c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:21.029779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eae8e911-109b-4a54-bc60-d0b77ef837c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:21.038031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eae8e911-109b-4a54-bc60-d0b77ef837c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086841 Jul 27 20:41:21.039135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 899/1938] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:20 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:21.251133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0eda8a2a-ced7-4f64-8dfc-660907fb48f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:21.251773 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0eda8a2a-ced7-4f64-8dfc-660907fb48f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:21.258197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0eda8a2a-ced7-4f64-8dfc-660907fb48f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:21.258640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0eda8a2a-ced7-4f64-8dfc-660907fb48f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:21.259388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0eda8a2a-ced7-4f64-8dfc-660907fb48f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:21.259816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0eda8a2a-ced7-4f64-8dfc-660907fb48f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:21.386816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0eda8a2a-ced7-4f64-8dfc-660907fb48f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:21.394647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0eda8a2a-ced7-4f64-8dfc-660907fb48f4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147381 Jul 27 20:41:21.395218 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1040/1939] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:21 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:22.059383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-90df3829-8102-4ad8-8e27-8c04413a30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:22.060122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-90df3829-8102-4ad8-8e27-8c04413a30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:22.066734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90df3829-8102-4ad8-8e27-8c04413a30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:22.067189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90df3829-8102-4ad8-8e27-8c04413a30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:22.067948 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90df3829-8102-4ad8-8e27-8c04413a30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:22.068414 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90df3829-8102-4ad8-8e27-8c04413a30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:22.129358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90df3829-8102-4ad8-8e27-8c04413a30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:22.137867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-90df3829-8102-4ad8-8e27-8c04413a30aa tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082375 Jul 27 20:41:22.138437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 900/1940] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:22 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:22.419372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e647cc13-8e4b-423e-80ae-f1fd22ebe9eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:22.420008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e647cc13-8e4b-423e-80ae-f1fd22ebe9eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:22.426438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e647cc13-8e4b-423e-80ae-f1fd22ebe9eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:22.426916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e647cc13-8e4b-423e-80ae-f1fd22ebe9eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:22.427674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e647cc13-8e4b-423e-80ae-f1fd22ebe9eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:22.428103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e647cc13-8e4b-423e-80ae-f1fd22ebe9eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:22.556284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e647cc13-8e4b-423e-80ae-f1fd22ebe9eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:22.564120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e647cc13-8e4b-423e-80ae-f1fd22ebe9eb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148595 Jul 27 20:41:22.564716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1041/1941] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:22 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:23.158533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b4c8f575-e91e-463e-9f86-ffe3976655d7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:23.159147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b4c8f575-e91e-463e-9f86-ffe3976655d7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:23.165616 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b4c8f575-e91e-463e-9f86-ffe3976655d7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:23.166067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b4c8f575-e91e-463e-9f86-ffe3976655d7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:23.166831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b4c8f575-e91e-463e-9f86-ffe3976655d7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:23.167272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b4c8f575-e91e-463e-9f86-ffe3976655d7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:23.227389 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b4c8f575-e91e-463e-9f86-ffe3976655d7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:23.235297 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b4c8f575-e91e-463e-9f86-ffe3976655d7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080688 Jul 27 20:41:23.235863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 901/1942] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:23 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:23.586654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fb73680c-ec19-4213-9ba0-d85e36fd1f05 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:23.587319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fb73680c-ec19-4213-9ba0-d85e36fd1f05 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:23.593887 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb73680c-ec19-4213-9ba0-d85e36fd1f05 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:23.594278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb73680c-ec19-4213-9ba0-d85e36fd1f05 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:23.595030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb73680c-ec19-4213-9ba0-d85e36fd1f05 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:23.595463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fb73680c-ec19-4213-9ba0-d85e36fd1f05 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:23.720883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fb73680c-ec19-4213-9ba0-d85e36fd1f05 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:23.729232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fb73680c-ec19-4213-9ba0-d85e36fd1f05 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146520 Jul 27 20:41:23.729803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1042/1943] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:23 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:24.256246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-916ca92e-bbb6-42e8-ad8b-894814a35902 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:24.256894 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-916ca92e-bbb6-42e8-ad8b-894814a35902 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:24.263503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-916ca92e-bbb6-42e8-ad8b-894814a35902 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:24.263955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-916ca92e-bbb6-42e8-ad8b-894814a35902 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:24.264743 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-916ca92e-bbb6-42e8-ad8b-894814a35902 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:24.265171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-916ca92e-bbb6-42e8-ad8b-894814a35902 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:24.328664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-916ca92e-bbb6-42e8-ad8b-894814a35902 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:24.337098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-916ca92e-bbb6-42e8-ad8b-894814a35902 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084711 Jul 27 20:41:24.337668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 902/1944] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:24 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:24.750928 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b1645da2-fecb-4ac2-bc70-556fa6236323 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:24.751558 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b1645da2-fecb-4ac2-bc70-556fa6236323 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:24.758120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1645da2-fecb-4ac2-bc70-556fa6236323 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:24.758597 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1645da2-fecb-4ac2-bc70-556fa6236323 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:24.759351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1645da2-fecb-4ac2-bc70-556fa6236323 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:24.759787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1645da2-fecb-4ac2-bc70-556fa6236323 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:24.885224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b1645da2-fecb-4ac2-bc70-556fa6236323 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:24.893134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b1645da2-fecb-4ac2-bc70-556fa6236323 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146070 Jul 27 20:41:24.897797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1043/1945] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:24 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:25.357684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-28a2c85d-7ddb-49a1-8207-8aaddc980e81 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:25.358310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-28a2c85d-7ddb-49a1-8207-8aaddc980e81 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:25.364809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28a2c85d-7ddb-49a1-8207-8aaddc980e81 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:25.365331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28a2c85d-7ddb-49a1-8207-8aaddc980e81 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:25.366090 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28a2c85d-7ddb-49a1-8207-8aaddc980e81 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:25.366530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28a2c85d-7ddb-49a1-8207-8aaddc980e81 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:25.427757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-28a2c85d-7ddb-49a1-8207-8aaddc980e81 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:25.431266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:25.436097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-28a2c85d-7ddb-49a1-8207-8aaddc980e81 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082303 Jul 27 20:41:25.436719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 903/1946] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:25 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:25.915086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf45a584-20f4-4034-a516-fda0e9972e3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:25.915700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf45a584-20f4-4034-a516-fda0e9972e3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:25.921780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf45a584-20f4-4034-a516-fda0e9972e3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:25.922229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf45a584-20f4-4034-a516-fda0e9972e3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:25.922982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf45a584-20f4-4034-a516-fda0e9972e3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:25.923415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf45a584-20f4-4034-a516-fda0e9972e3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:26.060129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf45a584-20f4-4034-a516-fda0e9972e3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:26.068090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf45a584-20f4-4034-a516-fda0e9972e3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.157026 Jul 27 20:41:26.068682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1044/1947] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:25 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:26.458544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f52bcb6f-34b7-4389-834f-7f8349397b2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:26.459159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f52bcb6f-34b7-4389-834f-7f8349397b2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:26.466421 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f52bcb6f-34b7-4389-834f-7f8349397b2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:26.466871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f52bcb6f-34b7-4389-834f-7f8349397b2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:26.467622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f52bcb6f-34b7-4389-834f-7f8349397b2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:26.468055 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f52bcb6f-34b7-4389-834f-7f8349397b2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:26.528160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f52bcb6f-34b7-4389-834f-7f8349397b2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:26.535885 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f52bcb6f-34b7-4389-834f-7f8349397b2d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081575 Jul 27 20:41:26.536474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 904/1948] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:26 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:27.089985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a0f0b821-6f09-4115-8c3c-baa2bcecb8f2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:27.090601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a0f0b821-6f09-4115-8c3c-baa2bcecb8f2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:27.097125 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0f0b821-6f09-4115-8c3c-baa2bcecb8f2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:27.097579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0f0b821-6f09-4115-8c3c-baa2bcecb8f2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:27.098343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0f0b821-6f09-4115-8c3c-baa2bcecb8f2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:27.098780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a0f0b821-6f09-4115-8c3c-baa2bcecb8f2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:27.229389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a0f0b821-6f09-4115-8c3c-baa2bcecb8f2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:27.231583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:27.237918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a0f0b821-6f09-4115-8c3c-baa2bcecb8f2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152521 Jul 27 20:41:27.238498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1045/1949] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:27 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:27.558642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c1cd8e38-270d-4eb5-8e20-9ec9fd92bd48 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:27.559366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c1cd8e38-270d-4eb5-8e20-9ec9fd92bd48 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:27.566504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1cd8e38-270d-4eb5-8e20-9ec9fd92bd48 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:27.566950 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1cd8e38-270d-4eb5-8e20-9ec9fd92bd48 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:27.567703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1cd8e38-270d-4eb5-8e20-9ec9fd92bd48 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:27.568157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1cd8e38-270d-4eb5-8e20-9ec9fd92bd48 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:27.633567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c1cd8e38-270d-4eb5-8e20-9ec9fd92bd48 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:27.641653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c1cd8e38-270d-4eb5-8e20-9ec9fd92bd48 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.088620 Jul 27 20:41:27.642227 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 905/1950] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:27 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:28.260050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8956f9c6-cfe5-4f6a-8d38-f9b40e40db30 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:28.260681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8956f9c6-cfe5-4f6a-8d38-f9b40e40db30 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:28.267228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8956f9c6-cfe5-4f6a-8d38-f9b40e40db30 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:28.267703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8956f9c6-cfe5-4f6a-8d38-f9b40e40db30 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:28.268493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8956f9c6-cfe5-4f6a-8d38-f9b40e40db30 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:28.268911 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8956f9c6-cfe5-4f6a-8d38-f9b40e40db30 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:28.399353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8956f9c6-cfe5-4f6a-8d38-f9b40e40db30 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:28.407476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8956f9c6-cfe5-4f6a-8d38-f9b40e40db30 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152149 Jul 27 20:41:28.408056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1046/1951] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:28 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:28.661367 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7328f683-6ccf-43cf-926d-d2ed29e30dc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:28.662007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7328f683-6ccf-43cf-926d-d2ed29e30dc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:28.668489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7328f683-6ccf-43cf-926d-d2ed29e30dc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:28.668937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7328f683-6ccf-43cf-926d-d2ed29e30dc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:28.669691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7328f683-6ccf-43cf-926d-d2ed29e30dc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:28.670124 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7328f683-6ccf-43cf-926d-d2ed29e30dc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:28.729362 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7328f683-6ccf-43cf-926d-d2ed29e30dc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:28.737092 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7328f683-6ccf-43cf-926d-d2ed29e30dc5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.079575 Jul 27 20:41:28.737657 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 906/1952] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:28 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:29.428712 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c72a9afd-c92e-4f2e-9305-e54aa2322756 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:29.429394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c72a9afd-c92e-4f2e-9305-e54aa2322756 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:29.435814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c72a9afd-c92e-4f2e-9305-e54aa2322756 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:29.436251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c72a9afd-c92e-4f2e-9305-e54aa2322756 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:29.437031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c72a9afd-c92e-4f2e-9305-e54aa2322756 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:29.437456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c72a9afd-c92e-4f2e-9305-e54aa2322756 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:29.566417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c72a9afd-c92e-4f2e-9305-e54aa2322756 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:29.574519 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c72a9afd-c92e-4f2e-9305-e54aa2322756 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149689 Jul 27 20:41:29.575109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1047/1953] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:29 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:29.758711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-27a90a89-a63b-4955-93a1-cdd74959f50c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:29.759327 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-27a90a89-a63b-4955-93a1-cdd74959f50c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:29.765864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-27a90a89-a63b-4955-93a1-cdd74959f50c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:29.766310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-27a90a89-a63b-4955-93a1-cdd74959f50c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:29.767063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-27a90a89-a63b-4955-93a1-cdd74959f50c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:29.767497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-27a90a89-a63b-4955-93a1-cdd74959f50c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:29.827420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-27a90a89-a63b-4955-93a1-cdd74959f50c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:29.835203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-27a90a89-a63b-4955-93a1-cdd74959f50c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080861 Jul 27 20:41:29.836346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 907/1954] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:29 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:30.596210 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c503ee4a-af8e-47cd-8594-1551dfc2093a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:30.596791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c503ee4a-af8e-47cd-8594-1551dfc2093a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:30.603801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c503ee4a-af8e-47cd-8594-1551dfc2093a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:30.604252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c503ee4a-af8e-47cd-8594-1551dfc2093a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:30.605051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c503ee4a-af8e-47cd-8594-1551dfc2093a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:30.605484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c503ee4a-af8e-47cd-8594-1551dfc2093a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:30.733556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c503ee4a-af8e-47cd-8594-1551dfc2093a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:30.741479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c503ee4a-af8e-47cd-8594-1551dfc2093a tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149180 Jul 27 20:41:30.742679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1048/1955] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:30 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:30.856280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-def23137-6f16-46ff-81c6-689f5f99a27f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:30.856856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-def23137-6f16-46ff-81c6-689f5f99a27f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:30.863418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-def23137-6f16-46ff-81c6-689f5f99a27f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:30.863877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-def23137-6f16-46ff-81c6-689f5f99a27f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:30.864671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-def23137-6f16-46ff-81c6-689f5f99a27f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:30.865110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-def23137-6f16-46ff-81c6-689f5f99a27f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:30.929006 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-def23137-6f16-46ff-81c6-689f5f99a27f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:30.936878 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-def23137-6f16-46ff-81c6-689f5f99a27f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084491 Jul 27 20:41:30.937452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 908/1956] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:30 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:31.764115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd8d1c06-e3c7-429a-8353-f34df347eb63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:31.764784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fd8d1c06-e3c7-429a-8353-f34df347eb63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:31.771205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8d1c06-e3c7-429a-8353-f34df347eb63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:31.771650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8d1c06-e3c7-429a-8353-f34df347eb63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:31.772431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8d1c06-e3c7-429a-8353-f34df347eb63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:31.772869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8d1c06-e3c7-429a-8353-f34df347eb63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:31.897196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd8d1c06-e3c7-429a-8353-f34df347eb63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:31.905335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd8d1c06-e3c7-429a-8353-f34df347eb63 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145087 Jul 27 20:41:31.905919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1049/1957] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:31 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:31.957318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-644d4f55-190c-49a9-ad81-2846407e0c9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:31.958029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-644d4f55-190c-49a9-ad81-2846407e0c9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:31.964595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-644d4f55-190c-49a9-ad81-2846407e0c9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:31.965050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-644d4f55-190c-49a9-ad81-2846407e0c9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:31.965818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-644d4f55-190c-49a9-ad81-2846407e0c9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:31.966254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-644d4f55-190c-49a9-ad81-2846407e0c9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:32.035201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-644d4f55-190c-49a9-ad81-2846407e0c9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:32.043906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-644d4f55-190c-49a9-ad81-2846407e0c9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.090497 Jul 27 20:41:32.047010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 909/1958] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:31 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:32.926432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7413f58b-00b6-401f-91d6-cb5c09f4f5d4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:32.927049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7413f58b-00b6-401f-91d6-cb5c09f4f5d4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:32.934065 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7413f58b-00b6-401f-91d6-cb5c09f4f5d4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:32.934512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7413f58b-00b6-401f-91d6-cb5c09f4f5d4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:32.935260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7413f58b-00b6-401f-91d6-cb5c09f4f5d4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:32.935691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7413f58b-00b6-401f-91d6-cb5c09f4f5d4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:33.065196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7413f58b-00b6-401f-91d6-cb5c09f4f5d4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:33.065829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8111c05b-ec0b-45f4-9dc7-73c17748ccb4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:33.066452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8111c05b-ec0b-45f4-9dc7-73c17748ccb4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:33.072915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8111c05b-ec0b-45f4-9dc7-73c17748ccb4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:33.073272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7413f58b-00b6-401f-91d6-cb5c09f4f5d4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150623 Jul 27 20:41:33.073402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8111c05b-ec0b-45f4-9dc7-73c17748ccb4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:33.073868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1050/1959] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:32 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:33.074096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8111c05b-ec0b-45f4-9dc7-73c17748ccb4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:33.074523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8111c05b-ec0b-45f4-9dc7-73c17748ccb4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:33.135478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8111c05b-ec0b-45f4-9dc7-73c17748ccb4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:33.143229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8111c05b-ec0b-45f4-9dc7-73c17748ccb4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081701 Jul 27 20:41:33.143794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 910/1960] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:33 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:34.094731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-79fbef43-26bd-40e7-8d65-88be6a525b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:34.095327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-79fbef43-26bd-40e7-8d65-88be6a525b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:34.101764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79fbef43-26bd-40e7-8d65-88be6a525b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:34.102336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79fbef43-26bd-40e7-8d65-88be6a525b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:34.103009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79fbef43-26bd-40e7-8d65-88be6a525b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:34.103439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79fbef43-26bd-40e7-8d65-88be6a525b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:34.164506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5d70c675-1ad5-4d4a-a879-86e846404ce4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:34.165153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5d70c675-1ad5-4d4a-a879-86e846404ce4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:34.171549 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5d70c675-1ad5-4d4a-a879-86e846404ce4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:34.171995 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5d70c675-1ad5-4d4a-a879-86e846404ce4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:34.172782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5d70c675-1ad5-4d4a-a879-86e846404ce4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:34.173217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5d70c675-1ad5-4d4a-a879-86e846404ce4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:34.238182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5d70c675-1ad5-4d4a-a879-86e846404ce4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:34.246813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5d70c675-1ad5-4d4a-a879-86e846404ce4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086373 Jul 27 20:41:34.247389 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 911/1961] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:34 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:34.260065 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-79fbef43-26bd-40e7-8d65-88be6a525b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:34.268546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-79fbef43-26bd-40e7-8d65-88be6a525b3b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.177816 Jul 27 20:41:34.269524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1051/1962] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:34 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:35.267125 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f7262f5e-4bb2-4c85-8a37-3df2bc215a73 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:35.267746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f7262f5e-4bb2-4c85-8a37-3df2bc215a73 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:35.270127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=58 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:35.275508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7262f5e-4bb2-4c85-8a37-3df2bc215a73 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.281608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7262f5e-4bb2-4c85-8a37-3df2bc215a73 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.281608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7262f5e-4bb2-4c85-8a37-3df2bc215a73 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.281608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7262f5e-4bb2-4c85-8a37-3df2bc215a73 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.289550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f6fdac60-fa25-41b8-acfe-8a923fd9a45b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:35.290197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f6fdac60-fa25-41b8-acfe-8a923fd9a45b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:35.296778 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6fdac60-fa25-41b8-acfe-8a923fd9a45b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.297231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6fdac60-fa25-41b8-acfe-8a923fd9a45b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.297993 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6fdac60-fa25-41b8-acfe-8a923fd9a45b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.298426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6fdac60-fa25-41b8-acfe-8a923fd9a45b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.349205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f7262f5e-4bb2-4c85-8a37-3df2bc215a73 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:35.357736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f7262f5e-4bb2-4c85-8a37-3df2bc215a73 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.094487 Jul 27 20:41:35.358326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 912/1963] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:35 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:35.447872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6fdac60-fa25-41b8-acfe-8a923fd9a45b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:35.455835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f6fdac60-fa25-41b8-acfe-8a923fd9a45b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.170267 Jul 27 20:41:35.456431 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1052/1964] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:35 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:35.821852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a5ded700-4912-4b39-bd95-3397a6eec355 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:35.822347 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a5ded700-4912-4b39-bd95-3397a6eec355 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:35.828247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5ded700-4912-4b39-bd95-3397a6eec355 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.828723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5ded700-4912-4b39-bd95-3397a6eec355 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.829475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5ded700-4912-4b39-bd95-3397a6eec355 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.829912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5ded700-4912-4b39-bd95-3397a6eec355 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.852667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a5ded700-4912-4b39-bd95-3397a6eec355 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a/ips" status: 200 len: 151 microversion: 2.20 time: 0.095236 Jul 27 20:41:35.853213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 913/1965] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Jul 27 20:41:35 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a/ips => generated 151 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:41:36.379352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5d63016c-690d-4496-94da-dd90f6290e6d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:36.380008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5d63016c-690d-4496-94da-dd90f6290e6d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:36.387121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d63016c-690d-4496-94da-dd90f6290e6d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:36.387572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d63016c-690d-4496-94da-dd90f6290e6d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:36.388329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d63016c-690d-4496-94da-dd90f6290e6d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:36.388788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d63016c-690d-4496-94da-dd90f6290e6d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:36.448511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5d63016c-690d-4496-94da-dd90f6290e6d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:36.456412 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5d63016c-690d-4496-94da-dd90f6290e6d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080859 Jul 27 20:41:36.456980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1053/1966] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:36 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:36.477260 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f7567935-6577-46ee-9e50-1984aea92ede tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:36.477867 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f7567935-6577-46ee-9e50-1984aea92ede tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:36.484358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7567935-6577-46ee-9e50-1984aea92ede tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:36.484840 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7567935-6577-46ee-9e50-1984aea92ede tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:36.485597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7567935-6577-46ee-9e50-1984aea92ede tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:36.486035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7567935-6577-46ee-9e50-1984aea92ede tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:36.621409 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f7567935-6577-46ee-9e50-1984aea92ede tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:36.624523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f7567935-6577-46ee-9e50-1984aea92ede tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151560 Jul 27 20:41:36.625097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 914/1967] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:36 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:37.477560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-21625357-70d8-4d03-8d2a-b27ab4022e24 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:37.478171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-21625357-70d8-4d03-8d2a-b27ab4022e24 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:37.484828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21625357-70d8-4d03-8d2a-b27ab4022e24 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:37.485271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21625357-70d8-4d03-8d2a-b27ab4022e24 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:37.486016 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21625357-70d8-4d03-8d2a-b27ab4022e24 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:37.486440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21625357-70d8-4d03-8d2a-b27ab4022e24 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:37.548288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-21625357-70d8-4d03-8d2a-b27ab4022e24 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:37.556088 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-21625357-70d8-4d03-8d2a-b27ab4022e24 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082985 Jul 27 20:41:37.556693 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1054/1968] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:37 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:37.648041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3a648453-6c5f-4e2a-ace6-d86affbe0201 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:37.650526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3a648453-6c5f-4e2a-ace6-d86affbe0201 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:37.657927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a648453-6c5f-4e2a-ace6-d86affbe0201 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:37.658370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a648453-6c5f-4e2a-ace6-d86affbe0201 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:37.659123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a648453-6c5f-4e2a-ace6-d86affbe0201 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:37.659550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3a648453-6c5f-4e2a-ace6-d86affbe0201 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:37.782975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3a648453-6c5f-4e2a-ace6-d86affbe0201 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:37.790872 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3a648453-6c5f-4e2a-ace6-d86affbe0201 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146689 Jul 27 20:41:37.791433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 915/1969] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:37 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:38.576374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4dc59b18-38ca-4463-85c5-a876fe8a761d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:38.577007 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4dc59b18-38ca-4463-85c5-a876fe8a761d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:38.583570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dc59b18-38ca-4463-85c5-a876fe8a761d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:38.584015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dc59b18-38ca-4463-85c5-a876fe8a761d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:38.584797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dc59b18-38ca-4463-85c5-a876fe8a761d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:38.585227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dc59b18-38ca-4463-85c5-a876fe8a761d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:38.647802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4dc59b18-38ca-4463-85c5-a876fe8a761d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:38.656085 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4dc59b18-38ca-4463-85c5-a876fe8a761d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083599 Jul 27 20:41:38.656679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1055/1970] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:38 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:38.811805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fe969afd-640a-418a-86cf-9b6f45fda04d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:38.812437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fe969afd-640a-418a-86cf-9b6f45fda04d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:38.818921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fe969afd-640a-418a-86cf-9b6f45fda04d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:38.819373 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fe969afd-640a-418a-86cf-9b6f45fda04d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:38.820130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fe969afd-640a-418a-86cf-9b6f45fda04d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:38.821117 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fe969afd-640a-418a-86cf-9b6f45fda04d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:38.947383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fe969afd-640a-418a-86cf-9b6f45fda04d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:38.955116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fe969afd-640a-418a-86cf-9b6f45fda04d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147211 Jul 27 20:41:38.955677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 916/1971] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:38 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:39.677251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0673d695-3b07-4c42-8535-09e9e9948630 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:39.677771 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0673d695-3b07-4c42-8535-09e9e9948630 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:39.684470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0673d695-3b07-4c42-8535-09e9e9948630 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:39.684926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0673d695-3b07-4c42-8535-09e9e9948630 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:39.685689 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0673d695-3b07-4c42-8535-09e9e9948630 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:39.686123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0673d695-3b07-4c42-8535-09e9e9948630 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:39.746958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0673d695-3b07-4c42-8535-09e9e9948630 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:39.754874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0673d695-3b07-4c42-8535-09e9e9948630 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081575 Jul 27 20:41:39.755446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1056/1972] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:39 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:39.976056 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eabb233a-95f2-4e96-9a18-7d4080e63528 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:39.977201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eabb233a-95f2-4e96-9a18-7d4080e63528 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:39.983578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eabb233a-95f2-4e96-9a18-7d4080e63528 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:39.984022 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eabb233a-95f2-4e96-9a18-7d4080e63528 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:39.984805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eabb233a-95f2-4e96-9a18-7d4080e63528 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:39.985333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eabb233a-95f2-4e96-9a18-7d4080e63528 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:40.114095 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eabb233a-95f2-4e96-9a18-7d4080e63528 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:40.122148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eabb233a-95f2-4e96-9a18-7d4080e63528 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150001 Jul 27 20:41:40.122717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 917/1973] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:39 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:40.775704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6b128f7c-4443-4625-9726-95bb6976bef1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:40.776326 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6b128f7c-4443-4625-9726-95bb6976bef1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:40.782831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b128f7c-4443-4625-9726-95bb6976bef1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:40.783277 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b128f7c-4443-4625-9726-95bb6976bef1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:40.784033 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b128f7c-4443-4625-9726-95bb6976bef1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:40.784496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b128f7c-4443-4625-9726-95bb6976bef1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:40.844242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6b128f7c-4443-4625-9726-95bb6976bef1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:40.852189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6b128f7c-4443-4625-9726-95bb6976bef1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080321 Jul 27 20:41:40.852806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1057/1974] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:40 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:41.142989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ede457ad-0af3-4e58-a66b-ab2e8e898a5d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:41.143533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ede457ad-0af3-4e58-a66b-ab2e8e898a5d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:41.150588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ede457ad-0af3-4e58-a66b-ab2e8e898a5d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:41.151040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ede457ad-0af3-4e58-a66b-ab2e8e898a5d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:41.151798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ede457ad-0af3-4e58-a66b-ab2e8e898a5d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:41.152236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ede457ad-0af3-4e58-a66b-ab2e8e898a5d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:41.279145 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ede457ad-0af3-4e58-a66b-ab2e8e898a5d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:41.287082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ede457ad-0af3-4e58-a66b-ab2e8e898a5d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148064 Jul 27 20:41:41.287645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 918/1975] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:41 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:41.873581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e05a2f4f-bbd0-4e63-9a97-80ee34d89deb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:41.874450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e05a2f4f-bbd0-4e63-9a97-80ee34d89deb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:41.876746 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=53 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:41.881464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e05a2f4f-bbd0-4e63-9a97-80ee34d89deb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:41.881915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e05a2f4f-bbd0-4e63-9a97-80ee34d89deb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:41.882675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e05a2f4f-bbd0-4e63-9a97-80ee34d89deb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:41.883113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e05a2f4f-bbd0-4e63-9a97-80ee34d89deb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:41.946362 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e05a2f4f-bbd0-4e63-9a97-80ee34d89deb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:41.954242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e05a2f4f-bbd0-4e63-9a97-80ee34d89deb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084763 Jul 27 20:41:41.954819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1058/1976] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:41 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:42.308546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eb9fb2e6-0f61-470e-9119-355d30868aeb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:42.309163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eb9fb2e6-0f61-470e-9119-355d30868aeb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:42.315705 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb9fb2e6-0f61-470e-9119-355d30868aeb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:42.316156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb9fb2e6-0f61-470e-9119-355d30868aeb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:42.316938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb9fb2e6-0f61-470e-9119-355d30868aeb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:42.317375 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb9fb2e6-0f61-470e-9119-355d30868aeb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:42.442457 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb9fb2e6-0f61-470e-9119-355d30868aeb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:42.450896 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eb9fb2e6-0f61-470e-9119-355d30868aeb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146716 Jul 27 20:41:42.451469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 919/1977] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:42 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:42.974810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-261ddf01-3d79-4a97-a733-c801aeedc444 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:42.975427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-261ddf01-3d79-4a97-a733-c801aeedc444 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:42.982538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-261ddf01-3d79-4a97-a733-c801aeedc444 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:42.982986 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-261ddf01-3d79-4a97-a733-c801aeedc444 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:42.983748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-261ddf01-3d79-4a97-a733-c801aeedc444 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:42.984185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-261ddf01-3d79-4a97-a733-c801aeedc444 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:43.047217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-261ddf01-3d79-4a97-a733-c801aeedc444 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:43.055231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-261ddf01-3d79-4a97-a733-c801aeedc444 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084335 Jul 27 20:41:43.055800 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1059/1978] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:42 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:43.471909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dceb6e3e-bc9a-4f62-96b6-35d1f3f5129e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:43.472557 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dceb6e3e-bc9a-4f62-96b6-35d1f3f5129e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:43.479035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-bc9a-4f62-96b6-35d1f3f5129e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:43.479480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-bc9a-4f62-96b6-35d1f3f5129e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:43.480247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-bc9a-4f62-96b6-35d1f3f5129e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:43.480691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-bc9a-4f62-96b6-35d1f3f5129e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:43.607853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dceb6e3e-bc9a-4f62-96b6-35d1f3f5129e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:43.611254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:43.615985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dceb6e3e-bc9a-4f62-96b6-35d1f3f5129e tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148029 Jul 27 20:41:43.616608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 920/1979] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:43 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:44.076812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf98df87-6acd-4991-8ff4-e8075b9b672e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:44.077540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf98df87-6acd-4991-8ff4-e8075b9b672e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:44.084017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf98df87-6acd-4991-8ff4-e8075b9b672e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:44.084504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf98df87-6acd-4991-8ff4-e8075b9b672e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:44.085286 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf98df87-6acd-4991-8ff4-e8075b9b672e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:44.086334 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf98df87-6acd-4991-8ff4-e8075b9b672e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:44.148026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf98df87-6acd-4991-8ff4-e8075b9b672e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:44.156546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf98df87-6acd-4991-8ff4-e8075b9b672e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083576 Jul 27 20:41:44.157116 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1060/1980] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:44 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:44.639381 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-389b7663-c7c9-4c62-9317-ac80bfab34ba tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:44.639934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-389b7663-c7c9-4c62-9317-ac80bfab34ba tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:44.646688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-389b7663-c7c9-4c62-9317-ac80bfab34ba tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:44.647139 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-389b7663-c7c9-4c62-9317-ac80bfab34ba tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:44.647938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-389b7663-c7c9-4c62-9317-ac80bfab34ba tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:44.648373 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-389b7663-c7c9-4c62-9317-ac80bfab34ba tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:44.774226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-389b7663-c7c9-4c62-9317-ac80bfab34ba tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:44.782029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-389b7663-c7c9-4c62-9317-ac80bfab34ba tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146572 Jul 27 20:41:44.782609 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 921/1981] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:44 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:45.176992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-93c5a43f-ca6b-4494-b84f-9d3ae64b6e36 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:45.177596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-93c5a43f-ca6b-4494-b84f-9d3ae64b6e36 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:45.184478 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93c5a43f-ca6b-4494-b84f-9d3ae64b6e36 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:45.184924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93c5a43f-ca6b-4494-b84f-9d3ae64b6e36 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:45.185670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93c5a43f-ca6b-4494-b84f-9d3ae64b6e36 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:45.186092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93c5a43f-ca6b-4494-b84f-9d3ae64b6e36 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:45.249075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-93c5a43f-ca6b-4494-b84f-9d3ae64b6e36 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:45.256891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-93c5a43f-ca6b-4494-b84f-9d3ae64b6e36 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083703 Jul 27 20:41:45.262932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1061/1982] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:45 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:45.803368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9c3aeecd-5712-432b-abf8-193016ef933d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:45.803981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9c3aeecd-5712-432b-abf8-193016ef933d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:45.810654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c3aeecd-5712-432b-abf8-193016ef933d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:45.811110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c3aeecd-5712-432b-abf8-193016ef933d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:45.811864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c3aeecd-5712-432b-abf8-193016ef933d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:45.812552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c3aeecd-5712-432b-abf8-193016ef933d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:45.941708 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9c3aeecd-5712-432b-abf8-193016ef933d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:45.950103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9c3aeecd-5712-432b-abf8-193016ef933d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150599 Jul 27 20:41:45.950671 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 922/1983] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:45 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:46.277972 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-538d04c5-8c03-4a72-8f30-3277937cc74d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:46.278576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-538d04c5-8c03-4a72-8f30-3277937cc74d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:46.284933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-538d04c5-8c03-4a72-8f30-3277937cc74d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:46.285373 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-538d04c5-8c03-4a72-8f30-3277937cc74d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:46.286110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-538d04c5-8c03-4a72-8f30-3277937cc74d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:46.286530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-538d04c5-8c03-4a72-8f30-3277937cc74d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:46.300710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:46.348507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-538d04c5-8c03-4a72-8f30-3277937cc74d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:46.356494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-538d04c5-8c03-4a72-8f30-3277937cc74d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082346 Jul 27 20:41:46.357064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1062/1984] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:46 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:46.971674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-409e4ca8-62e5-41d7-a62e-2e4d3aa40ae2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:46.972193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-409e4ca8-62e5-41d7-a62e-2e4d3aa40ae2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:46.979444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-409e4ca8-62e5-41d7-a62e-2e4d3aa40ae2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:46.979893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-409e4ca8-62e5-41d7-a62e-2e4d3aa40ae2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:46.980677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-409e4ca8-62e5-41d7-a62e-2e4d3aa40ae2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:46.981112 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-409e4ca8-62e5-41d7-a62e-2e4d3aa40ae2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:47.111526 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-409e4ca8-62e5-41d7-a62e-2e4d3aa40ae2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:47.119681 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-409e4ca8-62e5-41d7-a62e-2e4d3aa40ae2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151748 Jul 27 20:41:47.120257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 923/1985] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:46 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:47.377567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aaac8f0a-558b-4bfe-9834-35c348e8bc92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:47.378181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aaac8f0a-558b-4bfe-9834-35c348e8bc92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:47.385314 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaac8f0a-558b-4bfe-9834-35c348e8bc92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:47.385760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaac8f0a-558b-4bfe-9834-35c348e8bc92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:47.386513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaac8f0a-558b-4bfe-9834-35c348e8bc92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:47.387120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaac8f0a-558b-4bfe-9834-35c348e8bc92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:47.447278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aaac8f0a-558b-4bfe-9834-35c348e8bc92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:47.455050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aaac8f0a-558b-4bfe-9834-35c348e8bc92 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081398 Jul 27 20:41:47.455617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1063/1986] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:47 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:48.141448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-69d73e1d-bc94-4433-b1fa-c64137f28f26 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:48.142284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-69d73e1d-bc94-4433-b1fa-c64137f28f26 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:48.149053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69d73e1d-bc94-4433-b1fa-c64137f28f26 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:48.149506 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69d73e1d-bc94-4433-b1fa-c64137f28f26 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:48.150267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69d73e1d-bc94-4433-b1fa-c64137f28f26 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:48.150703 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69d73e1d-bc94-4433-b1fa-c64137f28f26 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:48.281621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-69d73e1d-bc94-4433-b1fa-c64137f28f26 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:48.290042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-69d73e1d-bc94-4433-b1fa-c64137f28f26 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152465 Jul 27 20:41:48.290848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 924/1987] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:48 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:48.475171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-90c53eda-2ec5-4c6f-a83b-169e44fa0f64 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:48.475799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-90c53eda-2ec5-4c6f-a83b-169e44fa0f64 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:48.482869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-90c53eda-2ec5-4c6f-a83b-169e44fa0f64 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:48.483321 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-90c53eda-2ec5-4c6f-a83b-169e44fa0f64 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:48.484075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-90c53eda-2ec5-4c6f-a83b-169e44fa0f64 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:48.484546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-90c53eda-2ec5-4c6f-a83b-169e44fa0f64 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:48.548417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-90c53eda-2ec5-4c6f-a83b-169e44fa0f64 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:48.555860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-90c53eda-2ec5-4c6f-a83b-169e44fa0f64 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084648 Jul 27 20:41:48.556456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1064/1988] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:48 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:49.311186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d2938ef3-a85f-4983-93d0-733f507e276c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:49.311723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d2938ef3-a85f-4983-93d0-733f507e276c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:49.318233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2938ef3-a85f-4983-93d0-733f507e276c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:49.318684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2938ef3-a85f-4983-93d0-733f507e276c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:49.319445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2938ef3-a85f-4983-93d0-733f507e276c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:49.320402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2938ef3-a85f-4983-93d0-733f507e276c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:49.451738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d2938ef3-a85f-4983-93d0-733f507e276c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:49.459611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d2938ef3-a85f-4983-93d0-733f507e276c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152421 Jul 27 20:41:49.460178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 925/1989] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:49 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:49.576915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-83b770ed-07ce-4d7f-9abb-da7953c8a76c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:49.577460 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-83b770ed-07ce-4d7f-9abb-da7953c8a76c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:49.584228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83b770ed-07ce-4d7f-9abb-da7953c8a76c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:49.586180 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83b770ed-07ce-4d7f-9abb-da7953c8a76c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:49.586180 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83b770ed-07ce-4d7f-9abb-da7953c8a76c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:49.586587 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83b770ed-07ce-4d7f-9abb-da7953c8a76c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:49.649548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-83b770ed-07ce-4d7f-9abb-da7953c8a76c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:49.657967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-83b770ed-07ce-4d7f-9abb-da7953c8a76c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085053 Jul 27 20:41:49.658532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1065/1990] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:49 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:50.481624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-faa3e85a-597a-4acd-9fc3-cc711e352554 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:50.482239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-faa3e85a-597a-4acd-9fc3-cc711e352554 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:50.488706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faa3e85a-597a-4acd-9fc3-cc711e352554 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:50.489159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faa3e85a-597a-4acd-9fc3-cc711e352554 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:50.495284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faa3e85a-597a-4acd-9fc3-cc711e352554 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:50.495284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faa3e85a-597a-4acd-9fc3-cc711e352554 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:50.619288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-faa3e85a-597a-4acd-9fc3-cc711e352554 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:50.627497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-faa3e85a-597a-4acd-9fc3-cc711e352554 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149875 Jul 27 20:41:50.628081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 926/1991] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:50 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:50.677973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ea27ec95-df44-4b6c-bf38-b8bd8a8b8003 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:50.678583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ea27ec95-df44-4b6c-bf38-b8bd8a8b8003 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:50.685602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea27ec95-df44-4b6c-bf38-b8bd8a8b8003 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:50.686051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea27ec95-df44-4b6c-bf38-b8bd8a8b8003 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:50.686796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea27ec95-df44-4b6c-bf38-b8bd8a8b8003 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:50.687227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea27ec95-df44-4b6c-bf38-b8bd8a8b8003 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:50.748207 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ea27ec95-df44-4b6c-bf38-b8bd8a8b8003 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:50.756150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ea27ec95-df44-4b6c-bf38-b8bd8a8b8003 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081976 Jul 27 20:41:50.756751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1066/1992] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:50 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:51.650183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4c29694b-6e5e-435d-8243-de22371e6c1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:51.650719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4c29694b-6e5e-435d-8243-de22371e6c1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:51.657218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c29694b-6e5e-435d-8243-de22371e6c1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:51.657666 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c29694b-6e5e-435d-8243-de22371e6c1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:51.658415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c29694b-6e5e-435d-8243-de22371e6c1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:51.658849 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c29694b-6e5e-435d-8243-de22371e6c1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:51.778363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cd0858d8-b8e5-4614-976b-94951cca07ac tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:51.778967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cd0858d8-b8e5-4614-976b-94951cca07ac tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:51.783961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4c29694b-6e5e-435d-8243-de22371e6c1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:51.785370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd0858d8-b8e5-4614-976b-94951cca07ac tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:51.785809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd0858d8-b8e5-4614-976b-94951cca07ac tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:51.786556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd0858d8-b8e5-4614-976b-94951cca07ac tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:51.786978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cd0858d8-b8e5-4614-976b-94951cca07ac tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:51.796339 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4c29694b-6e5e-435d-8243-de22371e6c1d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150651 Jul 27 20:41:51.797043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 927/1993] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:51 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:51.853117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cd0858d8-b8e5-4614-976b-94951cca07ac tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:51.860811 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cd0858d8-b8e5-4614-976b-94951cca07ac tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086300 Jul 27 20:41:51.861374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1067/1994] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:51 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:52.817583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d09575c4-13be-4ea9-a434-435ad1b4ea7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:52.818190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d09575c4-13be-4ea9-a434-435ad1b4ea7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:52.825250 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d09575c4-13be-4ea9-a434-435ad1b4ea7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:52.825690 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d09575c4-13be-4ea9-a434-435ad1b4ea7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:52.826433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d09575c4-13be-4ea9-a434-435ad1b4ea7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:52.826858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d09575c4-13be-4ea9-a434-435ad1b4ea7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:52.884264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-072d6f22-54ac-4269-95ae-d250bb890592 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:52.885017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-072d6f22-54ac-4269-95ae-d250bb890592 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:52.891546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-072d6f22-54ac-4269-95ae-d250bb890592 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:52.892068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-072d6f22-54ac-4269-95ae-d250bb890592 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:52.892868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-072d6f22-54ac-4269-95ae-d250bb890592 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:52.893301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-072d6f22-54ac-4269-95ae-d250bb890592 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:52.956688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-072d6f22-54ac-4269-95ae-d250bb890592 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:52.964503 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-072d6f22-54ac-4269-95ae-d250bb890592 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084641 Jul 27 20:41:52.965086 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1068/1995] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:52 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:52.978412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d09575c4-13be-4ea9-a434-435ad1b4ea7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:52.986260 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d09575c4-13be-4ea9-a434-435ad1b4ea7d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.172517 Jul 27 20:41:52.986828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 928/1996] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:52 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:53.985758 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5997771d-c5af-4d72-a2d3-2ab063de57c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:53.986368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5997771d-c5af-4d72-a2d3-2ab063de57c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:53.993497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5997771d-c5af-4d72-a2d3-2ab063de57c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:53.993950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5997771d-c5af-4d72-a2d3-2ab063de57c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:53.994959 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5997771d-c5af-4d72-a2d3-2ab063de57c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:53.995392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5997771d-c5af-4d72-a2d3-2ab063de57c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:54.007687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a6d2fef9-3281-413a-a4fa-d35a825e67b0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:54.008316 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a6d2fef9-3281-413a-a4fa-d35a825e67b0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:54.014826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a6d2fef9-3281-413a-a4fa-d35a825e67b0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:54.015274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a6d2fef9-3281-413a-a4fa-d35a825e67b0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:54.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a6d2fef9-3281-413a-a4fa-d35a825e67b0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:54.018180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a6d2fef9-3281-413a-a4fa-d35a825e67b0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:54.059700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5997771d-c5af-4d72-a2d3-2ab063de57c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:54.070610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5997771d-c5af-4d72-a2d3-2ab063de57c3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.088615 Jul 27 20:41:54.071257 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1069/1997] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:53 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:54.162424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a6d2fef9-3281-413a-a4fa-d35a825e67b0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:54.170654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a6d2fef9-3281-413a-a4fa-d35a825e67b0 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.167269 Jul 27 20:41:54.171366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 929/1998] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:54 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:55.092107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3d94146f-33ba-4761-a474-0bd209ed8c75 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:55.092759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3d94146f-33ba-4761-a474-0bd209ed8c75 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:55.098909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3d94146f-33ba-4761-a474-0bd209ed8c75 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:55.099356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3d94146f-33ba-4761-a474-0bd209ed8c75 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:55.100109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3d94146f-33ba-4761-a474-0bd209ed8c75 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:55.100590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3d94146f-33ba-4761-a474-0bd209ed8c75 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:55.160403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3d94146f-33ba-4761-a474-0bd209ed8c75 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:55.168195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3d94146f-33ba-4761-a474-0bd209ed8c75 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080000 Jul 27 20:41:55.168870 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1070/1999] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:55 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:55.194411 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9e501426-d7ff-44b7-ad20-2335c3e0913c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:55.195628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9e501426-d7ff-44b7-ad20-2335c3e0913c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:55.202128 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e501426-d7ff-44b7-ad20-2335c3e0913c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:55.202575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e501426-d7ff-44b7-ad20-2335c3e0913c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:55.203334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e501426-d7ff-44b7-ad20-2335c3e0913c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:55.203767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e501426-d7ff-44b7-ad20-2335c3e0913c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:55.330804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9e501426-d7ff-44b7-ad20-2335c3e0913c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:55.339014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9e501426-d7ff-44b7-ad20-2335c3e0913c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148520 Jul 27 20:41:55.339586 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 930/2000] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:55 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:56.189227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b49639f8-85a3-432e-9a4d-688abdd75460 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:56.189865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b49639f8-85a3-432e-9a4d-688abdd75460 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:56.196833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b49639f8-85a3-432e-9a4d-688abdd75460 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:56.197279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b49639f8-85a3-432e-9a4d-688abdd75460 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:56.198029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b49639f8-85a3-432e-9a4d-688abdd75460 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:56.198459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b49639f8-85a3-432e-9a4d-688abdd75460 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:56.261452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b49639f8-85a3-432e-9a4d-688abdd75460 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:56.269247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b49639f8-85a3-432e-9a4d-688abdd75460 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083857 Jul 27 20:41:56.269820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1071/2001] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:56 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:56.360152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-21c476f8-5b42-4f58-8c3b-19cc0642c638 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:56.360797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-21c476f8-5b42-4f58-8c3b-19cc0642c638 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:56.367866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21c476f8-5b42-4f58-8c3b-19cc0642c638 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:56.368315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21c476f8-5b42-4f58-8c3b-19cc0642c638 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:56.369100 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21c476f8-5b42-4f58-8c3b-19cc0642c638 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:56.369790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21c476f8-5b42-4f58-8c3b-19cc0642c638 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:56.496536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-21c476f8-5b42-4f58-8c3b-19cc0642c638 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:56.504439 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-21c476f8-5b42-4f58-8c3b-19cc0642c638 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148191 Jul 27 20:41:56.505014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 931/2002] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:56 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:57.290236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-be89cbaf-aec5-45ea-9123-378135e7bbee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:57.290912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-be89cbaf-aec5-45ea-9123-378135e7bbee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:57.297345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be89cbaf-aec5-45ea-9123-378135e7bbee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:57.297791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be89cbaf-aec5-45ea-9123-378135e7bbee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:57.298545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be89cbaf-aec5-45ea-9123-378135e7bbee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:57.298977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be89cbaf-aec5-45ea-9123-378135e7bbee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:57.361311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-be89cbaf-aec5-45ea-9123-378135e7bbee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:57.370099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-be89cbaf-aec5-45ea-9123-378135e7bbee tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083714 Jul 27 20:41:57.370669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1072/2003] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:57 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:57.526782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-97de698f-7db5-4bb4-9770-49f0c9f2a530 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:57.527393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-97de698f-7db5-4bb4-9770-49f0c9f2a530 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:57.534288 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97de698f-7db5-4bb4-9770-49f0c9f2a530 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:57.534736 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97de698f-7db5-4bb4-9770-49f0c9f2a530 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:57.535488 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97de698f-7db5-4bb4-9770-49f0c9f2a530 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:57.535920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97de698f-7db5-4bb4-9770-49f0c9f2a530 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:57.664771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-97de698f-7db5-4bb4-9770-49f0c9f2a530 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:57.672584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-97de698f-7db5-4bb4-9770-49f0c9f2a530 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150244 Jul 27 20:41:57.673157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 932/2004] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:57 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:58.390736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f31138f5-f457-4dc0-a569-3addf9d74a7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:58.391344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f31138f5-f457-4dc0-a569-3addf9d74a7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:58.398146 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f31138f5-f457-4dc0-a569-3addf9d74a7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:58.398595 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f31138f5-f457-4dc0-a569-3addf9d74a7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:58.399380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f31138f5-f457-4dc0-a569-3addf9d74a7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:58.399836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f31138f5-f457-4dc0-a569-3addf9d74a7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:58.460867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f31138f5-f457-4dc0-a569-3addf9d74a7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:58.468791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f31138f5-f457-4dc0-a569-3addf9d74a7f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081879 Jul 27 20:41:58.469358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1073/2005] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:58 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:58.693590 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-993a563b-73ba-4d8f-9913-5c092c1f85c5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:58.694135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-993a563b-73ba-4d8f-9913-5c092c1f85c5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:58.701151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-993a563b-73ba-4d8f-9913-5c092c1f85c5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:58.701599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-993a563b-73ba-4d8f-9913-5c092c1f85c5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:58.702344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-993a563b-73ba-4d8f-9913-5c092c1f85c5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:58.702779 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-993a563b-73ba-4d8f-9913-5c092c1f85c5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:58.830956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-993a563b-73ba-4d8f-9913-5c092c1f85c5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:58.838767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-993a563b-73ba-4d8f-9913-5c092c1f85c5 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149102 Jul 27 20:41:58.839333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 933/2006] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:58 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:59.489948 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a5873357-792e-4498-acdc-57c318cb75a6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:59.490560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a5873357-792e-4498-acdc-57c318cb75a6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:59.497783 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a5873357-792e-4498-acdc-57c318cb75a6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:59.498254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a5873357-792e-4498-acdc-57c318cb75a6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:59.498995 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a5873357-792e-4498-acdc-57c318cb75a6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:59.499432 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a5873357-792e-4498-acdc-57c318cb75a6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:59.563223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a5873357-792e-4498-acdc-57c318cb75a6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:59.571747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a5873357-792e-4498-acdc-57c318cb75a6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085106 Jul 27 20:41:59.572324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1074/2007] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:59 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:59.860332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cf917e25-4046-4a90-8114-37441c16db4f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:59.861004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cf917e25-4046-4a90-8114-37441c16db4f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:59.867479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf917e25-4046-4a90-8114-37441c16db4f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:59.868598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf917e25-4046-4a90-8114-37441c16db4f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:59.869715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf917e25-4046-4a90-8114-37441c16db4f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:59.870239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cf917e25-4046-4a90-8114-37441c16db4f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:59.994632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cf917e25-4046-4a90-8114-37441c16db4f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:00.002689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cf917e25-4046-4a90-8114-37441c16db4f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146259 Jul 27 20:42:00.003268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 934/2008] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:59 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:00.592050 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ddccae20-4f0c-48f9-bf0b-89ebf156f4a4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:00.592642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ddccae20-4f0c-48f9-bf0b-89ebf156f4a4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:00.599205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ddccae20-4f0c-48f9-bf0b-89ebf156f4a4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:00.599655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ddccae20-4f0c-48f9-bf0b-89ebf156f4a4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:00.600434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ddccae20-4f0c-48f9-bf0b-89ebf156f4a4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:00.600873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ddccae20-4f0c-48f9-bf0b-89ebf156f4a4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:00.660779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ddccae20-4f0c-48f9-bf0b-89ebf156f4a4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:00.668635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ddccae20-4f0c-48f9-bf0b-89ebf156f4a4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080496 Jul 27 20:42:00.669200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1075/2009] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:00 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:01.024524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fc162905-6d42-4c84-bd72-43652977ed04 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:01.025141 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fc162905-6d42-4c84-bd72-43652977ed04 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:01.031577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc162905-6d42-4c84-bd72-43652977ed04 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:01.032030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc162905-6d42-4c84-bd72-43652977ed04 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:01.032819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc162905-6d42-4c84-bd72-43652977ed04 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:01.033262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc162905-6d42-4c84-bd72-43652977ed04 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:01.417903 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fc162905-6d42-4c84-bd72-43652977ed04 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:01.425825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fc162905-6d42-4c84-bd72-43652977ed04 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.405241 Jul 27 20:42:01.426404 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 935/2010] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:01 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:01.688324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-34b87ec9-dd3e-4bd9-a625-0c75f90dd830 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:01.688888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-34b87ec9-dd3e-4bd9-a625-0c75f90dd830 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:01.695359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-34b87ec9-dd3e-4bd9-a625-0c75f90dd830 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:01.695812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-34b87ec9-dd3e-4bd9-a625-0c75f90dd830 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:01.696601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-34b87ec9-dd3e-4bd9-a625-0c75f90dd830 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:01.697684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-34b87ec9-dd3e-4bd9-a625-0c75f90dd830 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:01.756789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-34b87ec9-dd3e-4bd9-a625-0c75f90dd830 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:01.765260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-34b87ec9-dd3e-4bd9-a625-0c75f90dd830 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080855 Jul 27 20:42:01.765831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1076/2011] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:01 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:02.447569 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6ef7f7b0-7f68-42ec-a9cc-98fd0bad16e3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:02.448218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6ef7f7b0-7f68-42ec-a9cc-98fd0bad16e3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:02.454764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6ef7f7b0-7f68-42ec-a9cc-98fd0bad16e3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:02.455216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6ef7f7b0-7f68-42ec-a9cc-98fd0bad16e3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:02.455969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6ef7f7b0-7f68-42ec-a9cc-98fd0bad16e3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:02.456765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6ef7f7b0-7f68-42ec-a9cc-98fd0bad16e3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:02.584297 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6ef7f7b0-7f68-42ec-a9cc-98fd0bad16e3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:02.592626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6ef7f7b0-7f68-42ec-a9cc-98fd0bad16e3 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.149441 Jul 27 20:42:02.593144 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 936/2012] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:02 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:02.785818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c07fbc34-1011-4349-95e1-8efbe8581822 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:02.786430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c07fbc34-1011-4349-95e1-8efbe8581822 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:02.793451 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c07fbc34-1011-4349-95e1-8efbe8581822 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:02.793900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c07fbc34-1011-4349-95e1-8efbe8581822 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:02.794654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c07fbc34-1011-4349-95e1-8efbe8581822 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:02.795087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c07fbc34-1011-4349-95e1-8efbe8581822 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:02.856910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c07fbc34-1011-4349-95e1-8efbe8581822 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:02.864742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c07fbc34-1011-4349-95e1-8efbe8581822 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082808 Jul 27 20:42:02.865311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1077/2013] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:02 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:03.613668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a7a0ee30-c1dc-4806-b586-10ef9f0c37e2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:03.614234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a7a0ee30-c1dc-4806-b586-10ef9f0c37e2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:03.620999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7a0ee30-c1dc-4806-b586-10ef9f0c37e2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:03.621446 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7a0ee30-c1dc-4806-b586-10ef9f0c37e2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:03.622192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7a0ee30-c1dc-4806-b586-10ef9f0c37e2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:03.622624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7a0ee30-c1dc-4806-b586-10ef9f0c37e2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:03.640405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:03.748879 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a7a0ee30-c1dc-4806-b586-10ef9f0c37e2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:03.756722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a7a0ee30-c1dc-4806-b586-10ef9f0c37e2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147012 Jul 27 20:42:03.757300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 937/2014] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:03 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:03.885794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-592bdc3a-6b16-41d0-b915-e8d8bc0315b7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:03.886346 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-592bdc3a-6b16-41d0-b915-e8d8bc0315b7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:03.892605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-592bdc3a-6b16-41d0-b915-e8d8bc0315b7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:03.893055 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-592bdc3a-6b16-41d0-b915-e8d8bc0315b7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:03.893818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-592bdc3a-6b16-41d0-b915-e8d8bc0315b7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:03.894252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-592bdc3a-6b16-41d0-b915-e8d8bc0315b7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:03.953871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-592bdc3a-6b16-41d0-b915-e8d8bc0315b7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:03.961628 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-592bdc3a-6b16-41d0-b915-e8d8bc0315b7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080395 Jul 27 20:42:03.962198 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1078/2015] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:03 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:04.778730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-af139eb8-22f6-4f26-b6b7-57bfb5cb61df tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:04.779370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-af139eb8-22f6-4f26-b6b7-57bfb5cb61df tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:04.785961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af139eb8-22f6-4f26-b6b7-57bfb5cb61df tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:04.786410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af139eb8-22f6-4f26-b6b7-57bfb5cb61df tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:04.787166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af139eb8-22f6-4f26-b6b7-57bfb5cb61df tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:04.787602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af139eb8-22f6-4f26-b6b7-57bfb5cb61df tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:04.918417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-af139eb8-22f6-4f26-b6b7-57bfb5cb61df tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:04.926340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-af139eb8-22f6-4f26-b6b7-57bfb5cb61df tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151970 Jul 27 20:42:04.926919 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 938/2016] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:04 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:04.981912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5de30a62-4730-4263-ba46-ca93787e8bca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:04.982530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5de30a62-4730-4263-ba46-ca93787e8bca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:04.989006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de30a62-4730-4263-ba46-ca93787e8bca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:04.989456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de30a62-4730-4263-ba46-ca93787e8bca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:04.990216 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de30a62-4730-4263-ba46-ca93787e8bca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:04.990650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5de30a62-4730-4263-ba46-ca93787e8bca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:04.994776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:05.054008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5de30a62-4730-4263-ba46-ca93787e8bca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:05.062404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5de30a62-4730-4263-ba46-ca93787e8bca tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084409 Jul 27 20:42:05.062979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1079/2017] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:04 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:05.949372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-20beee5f-6625-4467-bd1e-5a9ad2779516 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:05.949970 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-20beee5f-6625-4467-bd1e-5a9ad2779516 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:05.952248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=54 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:05.957014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20beee5f-6625-4467-bd1e-5a9ad2779516 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:05.957466 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20beee5f-6625-4467-bd1e-5a9ad2779516 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:05.958226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20beee5f-6625-4467-bd1e-5a9ad2779516 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:05.958664 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-20beee5f-6625-4467-bd1e-5a9ad2779516 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:06.086267 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-20beee5f-6625-4467-bd1e-5a9ad2779516 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:06.086463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5a308f06-748f-4a12-8a06-541c4ddb5a8e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:06.086983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5a308f06-748f-4a12-8a06-541c4ddb5a8e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:06.094459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a308f06-748f-4a12-8a06-541c4ddb5a8e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:06.094905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a308f06-748f-4a12-8a06-541c4ddb5a8e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:06.095622 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-20beee5f-6625-4467-bd1e-5a9ad2779516 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150059 Jul 27 20:42:06.095743 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a308f06-748f-4a12-8a06-541c4ddb5a8e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:06.096090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a308f06-748f-4a12-8a06-541c4ddb5a8e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:06.096206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 939/2018] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:05 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:06.159557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a308f06-748f-4a12-8a06-541c4ddb5a8e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:06.167315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5a308f06-748f-4a12-8a06-541c4ddb5a8e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084752 Jul 27 20:42:06.167875 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1080/2019] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:06 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:07.120351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8dd6868e-8418-4cd7-b6dc-256c1459d9d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:07.121024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8dd6868e-8418-4cd7-b6dc-256c1459d9d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:07.127623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8dd6868e-8418-4cd7-b6dc-256c1459d9d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:07.128066 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8dd6868e-8418-4cd7-b6dc-256c1459d9d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:07.128846 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8dd6868e-8418-4cd7-b6dc-256c1459d9d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:07.129280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8dd6868e-8418-4cd7-b6dc-256c1459d9d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:07.187791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-efc2bc9c-a735-4003-8a5f-ff073d7dd83b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:07.188416 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-efc2bc9c-a735-4003-8a5f-ff073d7dd83b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:07.194890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-efc2bc9c-a735-4003-8a5f-ff073d7dd83b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:07.195372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-efc2bc9c-a735-4003-8a5f-ff073d7dd83b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:07.196137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-efc2bc9c-a735-4003-8a5f-ff073d7dd83b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:07.196611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-efc2bc9c-a735-4003-8a5f-ff073d7dd83b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:07.259756 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-efc2bc9c-a735-4003-8a5f-ff073d7dd83b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:07.267629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-efc2bc9c-a735-4003-8a5f-ff073d7dd83b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083732 Jul 27 20:42:07.268208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1081/2020] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:07 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:07.280761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8dd6868e-8418-4cd7-b6dc-256c1459d9d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:07.288691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8dd6868e-8418-4cd7-b6dc-256c1459d9d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.173684 Jul 27 20:42:07.289269 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 940/2021] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:07 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:08.288470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-10f16861-9a7f-4909-8520-3e4726839674 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:08.289106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-10f16861-9a7f-4909-8520-3e4726839674 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:08.295559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10f16861-9a7f-4909-8520-3e4726839674 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:08.296012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10f16861-9a7f-4909-8520-3e4726839674 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:08.296794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10f16861-9a7f-4909-8520-3e4726839674 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:08.297232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10f16861-9a7f-4909-8520-3e4726839674 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:08.310567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9fc36990-fcfe-4b6b-b720-e31e1fb5d0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:08.311196 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9fc36990-fcfe-4b6b-b720-e31e1fb5d0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:08.318249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fc36990-fcfe-4b6b-b720-e31e1fb5d0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:08.318428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fc36990-fcfe-4b6b-b720-e31e1fb5d0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:08.319240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fc36990-fcfe-4b6b-b720-e31e1fb5d0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:08.319592 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9fc36990-fcfe-4b6b-b720-e31e1fb5d0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:08.363123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-10f16861-9a7f-4909-8520-3e4726839674 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:08.372173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-10f16861-9a7f-4909-8520-3e4726839674 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.087525 Jul 27 20:42:08.374195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1082/2022] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:08 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:08.459326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9fc36990-fcfe-4b6b-b720-e31e1fb5d0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:08.467180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9fc36990-fcfe-4b6b-b720-e31e1fb5d0bb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.161015 Jul 27 20:42:08.467747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 941/2023] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:08 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:09.393015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8cfe62ec-d50d-4367-9dcd-a028ea77e00a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:09.393622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8cfe62ec-d50d-4367-9dcd-a028ea77e00a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:09.400155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cfe62ec-d50d-4367-9dcd-a028ea77e00a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:09.400628 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cfe62ec-d50d-4367-9dcd-a028ea77e00a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:09.401369 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cfe62ec-d50d-4367-9dcd-a028ea77e00a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:09.401794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cfe62ec-d50d-4367-9dcd-a028ea77e00a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:09.461695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8cfe62ec-d50d-4367-9dcd-a028ea77e00a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:09.469832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8cfe62ec-d50d-4367-9dcd-a028ea77e00a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080688 Jul 27 20:42:09.470433 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1083/2024] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:09 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:09.487700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7101c32b-b700-463e-9ad9-8875b8670fb9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:09.489039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7101c32b-b700-463e-9ad9-8875b8670fb9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:09.495708 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7101c32b-b700-463e-9ad9-8875b8670fb9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:09.496152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7101c32b-b700-463e-9ad9-8875b8670fb9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:09.496928 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7101c32b-b700-463e-9ad9-8875b8670fb9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:09.497355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7101c32b-b700-463e-9ad9-8875b8670fb9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:09.624304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7101c32b-b700-463e-9ad9-8875b8670fb9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:09.632349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7101c32b-b700-463e-9ad9-8875b8670fb9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148464 Jul 27 20:42:09.633019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 942/2025] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:09 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:10.491532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bcff4b85-2bd1-4c63-8097-f784322aca38 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:10.492178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bcff4b85-2bd1-4c63-8097-f784322aca38 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:10.499366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bcff4b85-2bd1-4c63-8097-f784322aca38 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:10.499813 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bcff4b85-2bd1-4c63-8097-f784322aca38 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:10.500609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bcff4b85-2bd1-4c63-8097-f784322aca38 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:10.501046 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bcff4b85-2bd1-4c63-8097-f784322aca38 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:10.564060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bcff4b85-2bd1-4c63-8097-f784322aca38 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:10.572074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bcff4b85-2bd1-4c63-8097-f784322aca38 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084536 Jul 27 20:42:10.573208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1084/2026] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:10 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:10.653994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eb07e922-1ea4-4f42-9ee8-e8fa0a5bf337 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:10.654608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eb07e922-1ea4-4f42-9ee8-e8fa0a5bf337 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:10.661093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb07e922-1ea4-4f42-9ee8-e8fa0a5bf337 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:10.661544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb07e922-1ea4-4f42-9ee8-e8fa0a5bf337 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:10.662596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb07e922-1ea4-4f42-9ee8-e8fa0a5bf337 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:10.663045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb07e922-1ea4-4f42-9ee8-e8fa0a5bf337 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:10.789616 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb07e922-1ea4-4f42-9ee8-e8fa0a5bf337 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:10.798262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eb07e922-1ea4-4f42-9ee8-e8fa0a5bf337 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147951 Jul 27 20:42:10.798841 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 943/2027] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:10 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:11.593229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3c4539a8-7513-42b6-8344-1d68fa1d2198 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:11.593789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3c4539a8-7513-42b6-8344-1d68fa1d2198 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:11.600326 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c4539a8-7513-42b6-8344-1d68fa1d2198 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:11.600799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c4539a8-7513-42b6-8344-1d68fa1d2198 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:11.601537 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c4539a8-7513-42b6-8344-1d68fa1d2198 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:11.601964 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3c4539a8-7513-42b6-8344-1d68fa1d2198 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:11.664159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3c4539a8-7513-42b6-8344-1d68fa1d2198 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:11.672500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3c4539a8-7513-42b6-8344-1d68fa1d2198 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083194 Jul 27 20:42:11.673260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1085/2028] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:11 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:11.820163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-68b16268-467e-4b56-b475-fb0e37bd1baa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:11.820809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-68b16268-467e-4b56-b475-fb0e37bd1baa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:11.827318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68b16268-467e-4b56-b475-fb0e37bd1baa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:11.827771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68b16268-467e-4b56-b475-fb0e37bd1baa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:11.828563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68b16268-467e-4b56-b475-fb0e37bd1baa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:11.829004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68b16268-467e-4b56-b475-fb0e37bd1baa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:11.959898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-68b16268-467e-4b56-b475-fb0e37bd1baa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:11.967771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-68b16268-467e-4b56-b475-fb0e37bd1baa tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151448 Jul 27 20:42:11.968346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 944/2029] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:11 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:12.693753 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fc52a19e-adb3-4cd2-9c01-e52d435f1a58 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:12.694344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fc52a19e-adb3-4cd2-9c01-e52d435f1a58 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:12.696754 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=56 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:12.702079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fc52a19e-adb3-4cd2-9c01-e52d435f1a58 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:12.702534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fc52a19e-adb3-4cd2-9c01-e52d435f1a58 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:12.703290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fc52a19e-adb3-4cd2-9c01-e52d435f1a58 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:12.703724 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fc52a19e-adb3-4cd2-9c01-e52d435f1a58 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:12.765118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fc52a19e-adb3-4cd2-9c01-e52d435f1a58 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:12.772734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fc52a19e-adb3-4cd2-9c01-e52d435f1a58 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082912 Jul 27 20:42:12.773294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1086/2030] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:12 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:12.989429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e311d828-5402-4fb8-9732-4f7a8dd9fcfd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:12.990047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e311d828-5402-4fb8-9732-4f7a8dd9fcfd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:12.998727 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e311d828-5402-4fb8-9732-4f7a8dd9fcfd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:12.999179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e311d828-5402-4fb8-9732-4f7a8dd9fcfd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:12.999946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e311d828-5402-4fb8-9732-4f7a8dd9fcfd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:13.000403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e311d828-5402-4fb8-9732-4f7a8dd9fcfd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:13.128343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e311d828-5402-4fb8-9732-4f7a8dd9fcfd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:13.137027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e311d828-5402-4fb8-9732-4f7a8dd9fcfd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151422 Jul 27 20:42:13.137606 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 945/2031] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:12 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:13.793704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd254c47-d4c7-490e-9017-b88d6b9acca0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:13.794328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fd254c47-d4c7-490e-9017-b88d6b9acca0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:13.801077 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd254c47-d4c7-490e-9017-b88d6b9acca0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:13.801520 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd254c47-d4c7-490e-9017-b88d6b9acca0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:13.802255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd254c47-d4c7-490e-9017-b88d6b9acca0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:13.802679 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd254c47-d4c7-490e-9017-b88d6b9acca0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:13.880085 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd254c47-d4c7-490e-9017-b88d6b9acca0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:13.888685 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd254c47-d4c7-490e-9017-b88d6b9acca0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.098828 Jul 27 20:42:13.889248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1087/2032] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:13 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:14.158360 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8d488992-1f01-4457-a297-fff3e67bd315 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:14.158922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8d488992-1f01-4457-a297-fff3e67bd315 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:14.165099 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d488992-1f01-4457-a297-fff3e67bd315 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:14.165554 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d488992-1f01-4457-a297-fff3e67bd315 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:14.166818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d488992-1f01-4457-a297-fff3e67bd315 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:14.167252 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d488992-1f01-4457-a297-fff3e67bd315 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:14.293442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8d488992-1f01-4457-a297-fff3e67bd315 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:14.301546 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8d488992-1f01-4457-a297-fff3e67bd315 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147284 Jul 27 20:42:14.302132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 946/2033] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:14 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:14.908089 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c7925608-36c0-4864-a825-481fe93b54a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:14.908840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c7925608-36c0-4864-a825-481fe93b54a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:14.915242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7925608-36c0-4864-a825-481fe93b54a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:14.915691 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7925608-36c0-4864-a825-481fe93b54a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:14.917062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7925608-36c0-4864-a825-481fe93b54a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:14.917498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7925608-36c0-4864-a825-481fe93b54a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:14.982165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7925608-36c0-4864-a825-481fe93b54a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:14.990173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c7925608-36c0-4864-a825-481fe93b54a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086017 Jul 27 20:42:14.990755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1088/2034] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:14 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:15.322484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ff1faa9e-8182-4aa5-8d6b-e187f2683d5c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:15.323127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ff1faa9e-8182-4aa5-8d6b-e187f2683d5c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:15.329593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff1faa9e-8182-4aa5-8d6b-e187f2683d5c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:15.330048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff1faa9e-8182-4aa5-8d6b-e187f2683d5c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:15.330813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff1faa9e-8182-4aa5-8d6b-e187f2683d5c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:15.331301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff1faa9e-8182-4aa5-8d6b-e187f2683d5c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:15.464257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ff1faa9e-8182-4aa5-8d6b-e187f2683d5c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:15.472164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ff1faa9e-8182-4aa5-8d6b-e187f2683d5c tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153605 Jul 27 20:42:15.472775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 947/2035] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:15 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:16.011962 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a4893e8c-7510-4e7b-a036-2f105675c597 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:16.012979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a4893e8c-7510-4e7b-a036-2f105675c597 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:16.020240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4893e8c-7510-4e7b-a036-2f105675c597 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:16.020716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4893e8c-7510-4e7b-a036-2f105675c597 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:16.021469 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4893e8c-7510-4e7b-a036-2f105675c597 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:16.021901 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a4893e8c-7510-4e7b-a036-2f105675c597 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:16.085062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a4893e8c-7510-4e7b-a036-2f105675c597 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:16.092901 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a4893e8c-7510-4e7b-a036-2f105675c597 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085573 Jul 27 20:42:16.093465 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1089/2036] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:16 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:16.495696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-689dd745-0f02-4475-b6e9-0ab9baef017d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:16.496829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-689dd745-0f02-4475-b6e9-0ab9baef017d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:16.504722 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-689dd745-0f02-4475-b6e9-0ab9baef017d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:16.505171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-689dd745-0f02-4475-b6e9-0ab9baef017d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:16.505933 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-689dd745-0f02-4475-b6e9-0ab9baef017d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:16.506368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-689dd745-0f02-4475-b6e9-0ab9baef017d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:16.631171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-689dd745-0f02-4475-b6e9-0ab9baef017d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:16.639200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-689dd745-0f02-4475-b6e9-0ab9baef017d tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.148591 Jul 27 20:42:16.639809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 948/2037] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:16 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:17.113819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f9928c94-5965-4826-aa61-f2c02195c337 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:17.114500 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f9928c94-5965-4826-aa61-f2c02195c337 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:17.122013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9928c94-5965-4826-aa61-f2c02195c337 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:17.122455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9928c94-5965-4826-aa61-f2c02195c337 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:17.123197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9928c94-5965-4826-aa61-f2c02195c337 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:17.123687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9928c94-5965-4826-aa61-f2c02195c337 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:17.187092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f9928c94-5965-4826-aa61-f2c02195c337 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:17.194850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f9928c94-5965-4826-aa61-f2c02195c337 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084893 Jul 27 20:42:17.195410 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1090/2038] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:17 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:17.660644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-67e54d8c-1f9d-4946-b530-7a231c1eb8cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:17.661263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-67e54d8c-1f9d-4946-b530-7a231c1eb8cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:17.668368 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-67e54d8c-1f9d-4946-b530-7a231c1eb8cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:17.668847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-67e54d8c-1f9d-4946-b530-7a231c1eb8cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:17.669606 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-67e54d8c-1f9d-4946-b530-7a231c1eb8cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:17.670048 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-67e54d8c-1f9d-4946-b530-7a231c1eb8cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:17.794727 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-67e54d8c-1f9d-4946-b530-7a231c1eb8cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:17.802561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-67e54d8c-1f9d-4946-b530-7a231c1eb8cd tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.145854 Jul 27 20:42:17.803137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 949/2039] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:17 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:18.216290 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-861bb67a-34ca-45be-a2d7-1c1c20a4559e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:18.217440 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-861bb67a-34ca-45be-a2d7-1c1c20a4559e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:18.223929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-861bb67a-34ca-45be-a2d7-1c1c20a4559e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:18.224394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-861bb67a-34ca-45be-a2d7-1c1c20a4559e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:18.225161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-861bb67a-34ca-45be-a2d7-1c1c20a4559e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:18.225597 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-861bb67a-34ca-45be-a2d7-1c1c20a4559e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:18.288546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-861bb67a-34ca-45be-a2d7-1c1c20a4559e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:18.297005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-861bb67a-34ca-45be-a2d7-1c1c20a4559e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085111 Jul 27 20:42:18.297582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1091/2040] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:18 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:18.824980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cadce043-aeb9-404c-b81e-86862ee6544b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:18.825564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cadce043-aeb9-404c-b81e-86862ee6544b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:18.832080 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cadce043-aeb9-404c-b81e-86862ee6544b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:18.832568 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cadce043-aeb9-404c-b81e-86862ee6544b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:18.833330 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cadce043-aeb9-404c-b81e-86862ee6544b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:18.833768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cadce043-aeb9-404c-b81e-86862ee6544b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:18.964164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cadce043-aeb9-404c-b81e-86862ee6544b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:18.972001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cadce043-aeb9-404c-b81e-86862ee6544b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151671 Jul 27 20:42:18.972599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 950/2041] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:18 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:19.317282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-33738163-b920-43c7-a517-98dad2cc2edd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:19.317852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-33738163-b920-43c7-a517-98dad2cc2edd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:19.324332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33738163-b920-43c7-a517-98dad2cc2edd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:19.324809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33738163-b920-43c7-a517-98dad2cc2edd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:19.325551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33738163-b920-43c7-a517-98dad2cc2edd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:19.326007 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33738163-b920-43c7-a517-98dad2cc2edd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:19.386480 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-33738163-b920-43c7-a517-98dad2cc2edd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:19.394329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-33738163-b920-43c7-a517-98dad2cc2edd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080871 Jul 27 20:42:19.394900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1092/2042] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:19 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:19.993138 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c8f5c6bd-d8fd-489b-9338-cf78ded34790 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:19.993759 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c8f5c6bd-d8fd-489b-9338-cf78ded34790 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:20.000496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8f5c6bd-d8fd-489b-9338-cf78ded34790 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:20.000948 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8f5c6bd-d8fd-489b-9338-cf78ded34790 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:20.001704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8f5c6bd-d8fd-489b-9338-cf78ded34790 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:20.002168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8f5c6bd-d8fd-489b-9338-cf78ded34790 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:20.134188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c8f5c6bd-d8fd-489b-9338-cf78ded34790 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:20.142611 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c8f5c6bd-d8fd-489b-9338-cf78ded34790 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153393 Jul 27 20:42:20.143192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 951/2043] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:19 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:20.414785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8e841ec6-43bc-43f5-9d53-333e5195e619 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:20.415402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8e841ec6-43bc-43f5-9d53-333e5195e619 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:20.421740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e841ec6-43bc-43f5-9d53-333e5195e619 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:20.422185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e841ec6-43bc-43f5-9d53-333e5195e619 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:20.422937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e841ec6-43bc-43f5-9d53-333e5195e619 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:20.423368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e841ec6-43bc-43f5-9d53-333e5195e619 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:20.488274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e841ec6-43bc-43f5-9d53-333e5195e619 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:20.497118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8e841ec6-43bc-43f5-9d53-333e5195e619 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086273 Jul 27 20:42:20.497692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1093/2044] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:20 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:21.164276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bf4bc672-a1a4-4f62-b43b-efcb0e952310 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:21.164936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bf4bc672-a1a4-4f62-b43b-efcb0e952310 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:21.171981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf4bc672-a1a4-4f62-b43b-efcb0e952310 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:21.172480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf4bc672-a1a4-4f62-b43b-efcb0e952310 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:21.173257 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf4bc672-a1a4-4f62-b43b-efcb0e952310 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:21.173698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf4bc672-a1a4-4f62-b43b-efcb0e952310 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:21.299706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bf4bc672-a1a4-4f62-b43b-efcb0e952310 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:21.307698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bf4bc672-a1a4-4f62-b43b-efcb0e952310 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147264 Jul 27 20:42:21.308277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 952/2045] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:21 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:21.518425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-511a7e58-07b5-4a1a-ad2f-ad3ea0da5c40 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:21.519072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-511a7e58-07b5-4a1a-ad2f-ad3ea0da5c40 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:21.526196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-511a7e58-07b5-4a1a-ad2f-ad3ea0da5c40 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:21.526647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-511a7e58-07b5-4a1a-ad2f-ad3ea0da5c40 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:21.527408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-511a7e58-07b5-4a1a-ad2f-ad3ea0da5c40 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:21.527841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-511a7e58-07b5-4a1a-ad2f-ad3ea0da5c40 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:21.588593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-511a7e58-07b5-4a1a-ad2f-ad3ea0da5c40 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:21.596407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-511a7e58-07b5-4a1a-ad2f-ad3ea0da5c40 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081864 Jul 27 20:42:21.596968 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1094/2046] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:21 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:22.329284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b108c36f-b857-4083-b321-de426d6b5cf2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:22.330340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b108c36f-b857-4083-b321-de426d6b5cf2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:22.339255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b108c36f-b857-4083-b321-de426d6b5cf2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:22.339701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b108c36f-b857-4083-b321-de426d6b5cf2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:22.340498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b108c36f-b857-4083-b321-de426d6b5cf2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:22.340957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b108c36f-b857-4083-b321-de426d6b5cf2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:22.469941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b108c36f-b857-4083-b321-de426d6b5cf2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:22.477884 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b108c36f-b857-4083-b321-de426d6b5cf2 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.152829 Jul 27 20:42:22.478959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 953/2047] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:22 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:22.616738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9110526a-ab0c-45e5-a136-78354a5fa35a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:22.617283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9110526a-ab0c-45e5-a136-78354a5fa35a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:22.624025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9110526a-ab0c-45e5-a136-78354a5fa35a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:22.624559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9110526a-ab0c-45e5-a136-78354a5fa35a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:22.625302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9110526a-ab0c-45e5-a136-78354a5fa35a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:22.625730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9110526a-ab0c-45e5-a136-78354a5fa35a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:22.686379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9110526a-ab0c-45e5-a136-78354a5fa35a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:22.688621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:22.694674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9110526a-ab0c-45e5-a136-78354a5fa35a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081795 Jul 27 20:42:22.695230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1095/2048] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:22 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:23.500696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ef1088d2-0ddd-410d-a198-c38cde6753ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:23.501396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ef1088d2-0ddd-410d-a198-c38cde6753ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:23.507737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef1088d2-0ddd-410d-a198-c38cde6753ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:23.508188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef1088d2-0ddd-410d-a198-c38cde6753ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:23.508981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef1088d2-0ddd-410d-a198-c38cde6753ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:23.510059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef1088d2-0ddd-410d-a198-c38cde6753ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:23.513990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:23.635159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ef1088d2-0ddd-410d-a198-c38cde6753ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:23.642991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ef1088d2-0ddd-410d-a198-c38cde6753ce tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.146246 Jul 27 20:42:23.643559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 954/2049] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:23 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:23.715549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-232666fa-694d-4a3a-8cfe-7808dfa023fc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:23.716148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-232666fa-694d-4a3a-8cfe-7808dfa023fc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:23.722848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-232666fa-694d-4a3a-8cfe-7808dfa023fc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:23.723287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-232666fa-694d-4a3a-8cfe-7808dfa023fc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:23.724032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-232666fa-694d-4a3a-8cfe-7808dfa023fc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:23.724481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-232666fa-694d-4a3a-8cfe-7808dfa023fc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:23.787399 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-232666fa-694d-4a3a-8cfe-7808dfa023fc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:23.795713 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-232666fa-694d-4a3a-8cfe-7808dfa023fc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084451 Jul 27 20:42:23.796276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1096/2050] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:23 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:24.664130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-58aa9314-451f-484c-b185-a191039bdedb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:24.664689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-58aa9314-451f-484c-b185-a191039bdedb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:24.671238 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58aa9314-451f-484c-b185-a191039bdedb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:24.671691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58aa9314-451f-484c-b185-a191039bdedb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:24.672483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58aa9314-451f-484c-b185-a191039bdedb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:24.672921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58aa9314-451f-484c-b185-a191039bdedb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:24.799043 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-58aa9314-451f-484c-b185-a191039bdedb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:24.807424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-58aa9314-451f-484c-b185-a191039bdedb tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147258 Jul 27 20:42:24.808096 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 955/2051] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:24 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:24.816008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-db84951c-000f-466a-adb8-af192a763520 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:24.816718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-db84951c-000f-466a-adb8-af192a763520 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:24.823665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db84951c-000f-466a-adb8-af192a763520 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:24.824105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db84951c-000f-466a-adb8-af192a763520 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:24.824869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db84951c-000f-466a-adb8-af192a763520 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:24.825300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-db84951c-000f-466a-adb8-af192a763520 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:24.885909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-db84951c-000f-466a-adb8-af192a763520 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:24.893750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-db84951c-000f-466a-adb8-af192a763520 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081620 Jul 27 20:42:24.894313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1097/2052] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:24 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:25.828483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c852ab26-c84b-47d2-8eb4-1a67263a0bd4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:25.829102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c852ab26-c84b-47d2-8eb4-1a67263a0bd4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:25.835504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c852ab26-c84b-47d2-8eb4-1a67263a0bd4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:25.835959 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c852ab26-c84b-47d2-8eb4-1a67263a0bd4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:25.836744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c852ab26-c84b-47d2-8eb4-1a67263a0bd4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:25.837181 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c852ab26-c84b-47d2-8eb4-1a67263a0bd4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:25.914438 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4d60a8bb-ce27-4374-8f23-caf978bfc1d2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:25.914824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4d60a8bb-ce27-4374-8f23-caf978bfc1d2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:25.920824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d60a8bb-ce27-4374-8f23-caf978bfc1d2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:25.921269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d60a8bb-ce27-4374-8f23-caf978bfc1d2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:25.922022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d60a8bb-ce27-4374-8f23-caf978bfc1d2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:25.922448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d60a8bb-ce27-4374-8f23-caf978bfc1d2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:25.990164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4d60a8bb-ce27-4374-8f23-caf978bfc1d2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:25.993525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c852ab26-c84b-47d2-8eb4-1a67263a0bd4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:25.999235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4d60a8bb-ce27-4374-8f23-caf978bfc1d2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.089154 Jul 27 20:42:26.000012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1098/2053] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:25 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:26.001853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c852ab26-c84b-47d2-8eb4-1a67263a0bd4 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.177259 Jul 27 20:42:26.002448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 956/2054] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:25 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:27.020196 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5b48b21b-c619-4cd5-9f01-ae5495520fdb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:27.020845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5b48b21b-c619-4cd5-9f01-ae5495520fdb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:27.028014 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b48b21b-c619-4cd5-9f01-ae5495520fdb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:27.028526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b48b21b-c619-4cd5-9f01-ae5495520fdb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:27.029272 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b48b21b-c619-4cd5-9f01-ae5495520fdb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:27.029695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b48b21b-c619-4cd5-9f01-ae5495520fdb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:27.031574 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-42189122-e9d1-4e8e-9a6a-56fb70d89fb8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:27.032190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-42189122-e9d1-4e8e-9a6a-56fb70d89fb8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:27.038627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-42189122-e9d1-4e8e-9a6a-56fb70d89fb8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:27.045133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-42189122-e9d1-4e8e-9a6a-56fb70d89fb8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:27.045133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-42189122-e9d1-4e8e-9a6a-56fb70d89fb8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:27.045133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-42189122-e9d1-4e8e-9a6a-56fb70d89fb8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:27.099236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5b48b21b-c619-4cd5-9f01-ae5495520fdb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:27.108928 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5b48b21b-c619-4cd5-9f01-ae5495520fdb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.092592 Jul 27 20:42:27.109507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1099/2055] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:27 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:27.185178 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-42189122-e9d1-4e8e-9a6a-56fb70d89fb8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:27.193079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-42189122-e9d1-4e8e-9a6a-56fb70d89fb8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.165485 Jul 27 20:42:27.193644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 957/2056] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:27 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:28.130836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9464dc1b-2cea-44b1-a145-bcc231e3d5a3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:28.131507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9464dc1b-2cea-44b1-a145-bcc231e3d5a3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:28.138847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9464dc1b-2cea-44b1-a145-bcc231e3d5a3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:28.139288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9464dc1b-2cea-44b1-a145-bcc231e3d5a3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:28.140025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9464dc1b-2cea-44b1-a145-bcc231e3d5a3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:28.140482 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9464dc1b-2cea-44b1-a145-bcc231e3d5a3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:28.200897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9464dc1b-2cea-44b1-a145-bcc231e3d5a3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:28.208677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9464dc1b-2cea-44b1-a145-bcc231e3d5a3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081753 Jul 27 20:42:28.209244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1100/2057] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:28 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:28.216567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f72a9cbd-a124-465c-99cf-9b6c5f074485 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:28.217193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f72a9cbd-a124-465c-99cf-9b6c5f074485 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:28.223718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f72a9cbd-a124-465c-99cf-9b6c5f074485 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:28.224170 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f72a9cbd-a124-465c-99cf-9b6c5f074485 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:28.224972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f72a9cbd-a124-465c-99cf-9b6c5f074485 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:28.225410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f72a9cbd-a124-465c-99cf-9b6c5f074485 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:28.354729 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f72a9cbd-a124-465c-99cf-9b6c5f074485 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:28.362783 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f72a9cbd-a124-465c-99cf-9b6c5f074485 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.150150 Jul 27 20:42:28.363352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 958/2058] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:28 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:29.228971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d8365e0b-b1a0-4992-ae0c-583e31a32f53 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:29.229614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d8365e0b-b1a0-4992-ae0c-583e31a32f53 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:29.236114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8365e0b-b1a0-4992-ae0c-583e31a32f53 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:29.236614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8365e0b-b1a0-4992-ae0c-583e31a32f53 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:29.237376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8365e0b-b1a0-4992-ae0c-583e31a32f53 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:29.237810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8365e0b-b1a0-4992-ae0c-583e31a32f53 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:29.299176 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8365e0b-b1a0-4992-ae0c-583e31a32f53 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:29.307807 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d8365e0b-b1a0-4992-ae0c-583e31a32f53 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082673 Jul 27 20:42:29.308404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1101/2059] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:29 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:29.385517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cd7141d3-5dcb-438c-9920-d3f9383087db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:29.386153 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cd7141d3-5dcb-438c-9920-d3f9383087db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:29.392654 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd7141d3-5dcb-438c-9920-d3f9383087db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:29.393098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd7141d3-5dcb-438c-9920-d3f9383087db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:29.393838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd7141d3-5dcb-438c-9920-d3f9383087db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:29.394266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd7141d3-5dcb-438c-9920-d3f9383087db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:29.527719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd7141d3-5dcb-438c-9920-d3f9383087db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:29.535872 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cd7141d3-5dcb-438c-9920-d3f9383087db tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.154845 Jul 27 20:42:29.536479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 959/2060] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:29 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:30.327726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c1c9de62-5b2e-4ac9-9ff9-1fec15f45f41 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:30.328318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c1c9de62-5b2e-4ac9-9ff9-1fec15f45f41 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:30.334827 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c1c9de62-5b2e-4ac9-9ff9-1fec15f45f41 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:30.335270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c1c9de62-5b2e-4ac9-9ff9-1fec15f45f41 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:30.336044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c1c9de62-5b2e-4ac9-9ff9-1fec15f45f41 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:30.336497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c1c9de62-5b2e-4ac9-9ff9-1fec15f45f41 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:30.398422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c1c9de62-5b2e-4ac9-9ff9-1fec15f45f41 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:30.406907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c1c9de62-5b2e-4ac9-9ff9-1fec15f45f41 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083074 Jul 27 20:42:30.407476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1102/2061] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:30 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:30.556613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4e32c359-edd7-4556-9d9d-2cccaafb7177 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:30.557256 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4e32c359-edd7-4556-9d9d-2cccaafb7177 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:30.563765 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e32c359-edd7-4556-9d9d-2cccaafb7177 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:30.564206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e32c359-edd7-4556-9d9d-2cccaafb7177 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:30.565030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e32c359-edd7-4556-9d9d-2cccaafb7177 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:30.565455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e32c359-edd7-4556-9d9d-2cccaafb7177 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:30.698478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4e32c359-edd7-4556-9d9d-2cccaafb7177 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:30.706428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4e32c359-edd7-4556-9d9d-2cccaafb7177 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153822 Jul 27 20:42:30.707005 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 960/2062] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:30 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:31.427190 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-770ac685-5622-404f-b337-0f334e5d432f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:31.427792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-770ac685-5622-404f-b337-0f334e5d432f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:31.435092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-770ac685-5622-404f-b337-0f334e5d432f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:31.435533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-770ac685-5622-404f-b337-0f334e5d432f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:31.436273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-770ac685-5622-404f-b337-0f334e5d432f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:31.436722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-770ac685-5622-404f-b337-0f334e5d432f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:31.497789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-770ac685-5622-404f-b337-0f334e5d432f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:31.505623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-770ac685-5622-404f-b337-0f334e5d432f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082370 Jul 27 20:42:31.506182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1103/2063] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:31 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:31.727481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aa7ff2f3-fd26-40ad-aacd-dc1f17d4d982 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:31.728814 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aa7ff2f3-fd26-40ad-aacd-dc1f17d4d982 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:31.735152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa7ff2f3-fd26-40ad-aacd-dc1f17d4d982 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:31.735593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa7ff2f3-fd26-40ad-aacd-dc1f17d4d982 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:31.736338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa7ff2f3-fd26-40ad-aacd-dc1f17d4d982 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:31.736789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa7ff2f3-fd26-40ad-aacd-dc1f17d4d982 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:31.862993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aa7ff2f3-fd26-40ad-aacd-dc1f17d4d982 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:31.871397 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aa7ff2f3-fd26-40ad-aacd-dc1f17d4d982 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147719 Jul 27 20:42:31.871963 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 961/2064] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:31 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:32.525902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2a051533-c57f-4e85-beab-dd42c45f4932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:32.526508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2a051533-c57f-4e85-beab-dd42c45f4932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:32.532973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a051533-c57f-4e85-beab-dd42c45f4932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:32.533419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a051533-c57f-4e85-beab-dd42c45f4932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:32.534154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a051533-c57f-4e85-beab-dd42c45f4932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:32.534579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a051533-c57f-4e85-beab-dd42c45f4932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:32.596733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2a051533-c57f-4e85-beab-dd42c45f4932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:32.604505 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2a051533-c57f-4e85-beab-dd42c45f4932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082801 Jul 27 20:42:32.605066 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1104/2065] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:32 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:32.892951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-567513e7-5c3f-494c-8af9-c40d8a1a520b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:32.893475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-567513e7-5c3f-494c-8af9-c40d8a1a520b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:32.899886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-567513e7-5c3f-494c-8af9-c40d8a1a520b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:32.900329 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-567513e7-5c3f-494c-8af9-c40d8a1a520b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:32.901106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-567513e7-5c3f-494c-8af9-c40d8a1a520b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:32.901538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-567513e7-5c3f-494c-8af9-c40d8a1a520b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:33.032245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-567513e7-5c3f-494c-8af9-c40d8a1a520b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:33.040824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-567513e7-5c3f-494c-8af9-c40d8a1a520b tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.151162 Jul 27 20:42:33.041405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 962/2066] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:32 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:33.625624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1534e5de-0561-4d57-863d-73f84b102f2b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:33.626276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1534e5de-0561-4d57-863d-73f84b102f2b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:33.633003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1534e5de-0561-4d57-863d-73f84b102f2b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:33.633452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1534e5de-0561-4d57-863d-73f84b102f2b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:33.634766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1534e5de-0561-4d57-863d-73f84b102f2b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:33.635202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1534e5de-0561-4d57-863d-73f84b102f2b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:33.694090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1534e5de-0561-4d57-863d-73f84b102f2b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:33.702488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1534e5de-0561-4d57-863d-73f84b102f2b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081149 Jul 27 20:42:33.703061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1105/2067] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:33 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:34.062119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c92ef323-77c7-4ca3-b291-bb842fae74d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:34.062756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c92ef323-77c7-4ca3-b291-bb842fae74d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:34.069776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c92ef323-77c7-4ca3-b291-bb842fae74d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:34.070226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c92ef323-77c7-4ca3-b291-bb842fae74d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:34.070991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c92ef323-77c7-4ca3-b291-bb842fae74d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:34.072067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c92ef323-77c7-4ca3-b291-bb842fae74d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:34.203957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c92ef323-77c7-4ca3-b291-bb842fae74d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:34.212213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c92ef323-77c7-4ca3-b291-bb842fae74d6 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153780 Jul 27 20:42:34.212833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 963/2068] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:34 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:34.723630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eb5aaeff-4ed6-4eb2-87af-672e973491d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:34.724191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eb5aaeff-4ed6-4eb2-87af-672e973491d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:34.730809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb5aaeff-4ed6-4eb2-87af-672e973491d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:34.731261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb5aaeff-4ed6-4eb2-87af-672e973491d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:34.732015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb5aaeff-4ed6-4eb2-87af-672e973491d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:34.732485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb5aaeff-4ed6-4eb2-87af-672e973491d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:34.793037 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eb5aaeff-4ed6-4eb2-87af-672e973491d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:34.801024 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eb5aaeff-4ed6-4eb2-87af-672e973491d8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081284 Jul 27 20:42:34.801597 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1106/2069] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:34 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:35.234022 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dcecdb68-1d95-4b4b-a8b8-f3a019b996e9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:35.234617 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dcecdb68-1d95-4b4b-a8b8-f3a019b996e9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:35.242936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dcecdb68-1d95-4b4b-a8b8-f3a019b996e9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.243380 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dcecdb68-1d95-4b4b-a8b8-f3a019b996e9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.246525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dcecdb68-1d95-4b4b-a8b8-f3a019b996e9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.247180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dcecdb68-1d95-4b4b-a8b8-f3a019b996e9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.379673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dcecdb68-1d95-4b4b-a8b8-f3a019b996e9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:35.387538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dcecdb68-1d95-4b4b-a8b8-f3a019b996e9 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.157480 Jul 27 20:42:35.388089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 964/2070] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:35 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:35.824514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0dbcde1b-05b0-4abf-ae4f-48b474db2c1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:35.825122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0dbcde1b-05b0-4abf-ae4f-48b474db2c1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:35.831521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0dbcde1b-05b0-4abf-ae4f-48b474db2c1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.831960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0dbcde1b-05b0-4abf-ae4f-48b474db2c1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.832731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0dbcde1b-05b0-4abf-ae4f-48b474db2c1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.833158 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0dbcde1b-05b0-4abf-ae4f-48b474db2c1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.893446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0dbcde1b-05b0-4abf-ae4f-48b474db2c1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:35.901153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0dbcde1b-05b0-4abf-ae4f-48b474db2c1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080590 Jul 27 20:42:35.901720 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1107/2071] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:35 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:35.926578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2c910740-bdd3-4bda-9a9f-0529c6b59509 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:35.927151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2c910740-bdd3-4bda-9a9f-0529c6b59509 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:35.933764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c910740-bdd3-4bda-9a9f-0529c6b59509 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.934216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c910740-bdd3-4bda-9a9f-0529c6b59509 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.934975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c910740-bdd3-4bda-9a9f-0529c6b59509 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.935411 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c910740-bdd3-4bda-9a9f-0529c6b59509 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.959123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2c910740-bdd3-4bda-9a9f-0529c6b59509 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:42:36.140312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=54 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:36.197025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2c910740-bdd3-4bda-9a9f-0529c6b59509 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 204 len: 0 microversion: 2.20 time: 0.274029 Jul 27 20:42:36.198375 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 965/2072] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 20:42:35 2022] DELETE /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 20:42:36.207543 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:36.208152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:36.214159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.215179 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.215430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.215779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.348521 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:36.356895 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:36.358402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:36.359544 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9935f39e-5b06-43fa-8aea-e029c217507f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1722 microversion: 2.20 time: 0.156482 Jul 27 20:42:36.360112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1108/2073] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:36 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:36.409595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1c9a7ca9-3c33-4501-9b32-e6b9f20c5e95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:36.410226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1c9a7ca9-3c33-4501-9b32-e6b9f20c5e95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:36.417492 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c9a7ca9-3c33-4501-9b32-e6b9f20c5e95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.417922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c9a7ca9-3c33-4501-9b32-e6b9f20c5e95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.418442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c9a7ca9-3c33-4501-9b32-e6b9f20c5e95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.418880 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c9a7ca9-3c33-4501-9b32-e6b9f20c5e95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.544975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1c9a7ca9-3c33-4501-9b32-e6b9f20c5e95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:36.552737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1c9a7ca9-3c33-4501-9b32-e6b9f20c5e95 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.147293 Jul 27 20:42:36.553311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 966/2074] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:36 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:36.922030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9282a7b8-a743-4918-96dd-95b61d4e1c65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:36.922645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9282a7b8-a743-4918-96dd-95b61d4e1c65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:36.929164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9282a7b8-a743-4918-96dd-95b61d4e1c65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.929614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9282a7b8-a743-4918-96dd-95b61d4e1c65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.930367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9282a7b8-a743-4918-96dd-95b61d4e1c65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.930803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9282a7b8-a743-4918-96dd-95b61d4e1c65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.996249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9282a7b8-a743-4918-96dd-95b61d4e1c65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:37.004108 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9282a7b8-a743-4918-96dd-95b61d4e1c65 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085940 Jul 27 20:42:37.004710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1109/2075] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:36 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:37.384210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:37.384855 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:37.390976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:37.391410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:37.392166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:37.392631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:37.520443 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:37.528369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:37.529965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:37.531102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0f80ead6-1060-4399-a5f7-9059869b7b95 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1722 microversion: 2.20 time: 0.150790 Jul 27 20:42:37.531674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 967/2076] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:37 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:37.575318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4dad0c68-c715-44fb-a65b-ca6f5064c6e8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:37.575924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4dad0c68-c715-44fb-a65b-ca6f5064c6e8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:37.581908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dad0c68-c715-44fb-a65b-ca6f5064c6e8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:37.582359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dad0c68-c715-44fb-a65b-ca6f5064c6e8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:37.583111 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dad0c68-c715-44fb-a65b-ca6f5064c6e8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:37.583542 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4dad0c68-c715-44fb-a65b-ca6f5064c6e8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:37.716304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4dad0c68-c715-44fb-a65b-ca6f5064c6e8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:37.724110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4dad0c68-c715-44fb-a65b-ca6f5064c6e8 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153316 Jul 27 20:42:37.724706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1110/2077] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:37 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:38.034798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-47ab5de3-c038-4e47-8246-4ffa0d2ee96a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:38.035500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-47ab5de3-c038-4e47-8246-4ffa0d2ee96a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:38.042248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47ab5de3-c038-4e47-8246-4ffa0d2ee96a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.042696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47ab5de3-c038-4e47-8246-4ffa0d2ee96a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.043465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47ab5de3-c038-4e47-8246-4ffa0d2ee96a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.043899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47ab5de3-c038-4e47-8246-4ffa0d2ee96a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.116485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-47ab5de3-c038-4e47-8246-4ffa0d2ee96a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:38.125200 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-47ab5de3-c038-4e47-8246-4ffa0d2ee96a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.094484 Jul 27 20:42:38.136447 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 968/2078] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:38 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:38.554640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:38.555601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:38.563808 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.564706 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.565747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.572493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.634351 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:38.642311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:38.643828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:38.645004 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-da87c658-cbf3-4d03-b34e-9e76684a7140 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1655 microversion: 2.20 time: 0.094721 Jul 27 20:42:38.645573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1111/2079] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:38 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:38.744370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-80caf3e4-e303-4efc-88d8-94e455618921 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:38.745583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-80caf3e4-e303-4efc-88d8-94e455618921 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:38.752342 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80caf3e4-e303-4efc-88d8-94e455618921 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.752823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80caf3e4-e303-4efc-88d8-94e455618921 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.753582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80caf3e4-e303-4efc-88d8-94e455618921 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.754017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80caf3e4-e303-4efc-88d8-94e455618921 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.758201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:38.914498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-fbb8d0c8-b051-48cf-afca-0cd0e5bc6d86 req-658991f3-ebbc-45b5-8e02-5587f2d579b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2351ed2-58ed-4953-b7a6-5c4773b2598a", "name": "network-vif-deleted", "tag": "01db6eee-31a9-4f2e-be4c-31e4d1b8441b"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:42:38.930356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-fbb8d0c8-b051-48cf-afca-0cd0e5bc6d86 req-658991f3-ebbc-45b5-8e02-5587f2d579b2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.933282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-fbb8d0c8-b051-48cf-afca-0cd0e5bc6d86 req-658991f3-ebbc-45b5-8e02-5587f2d579b2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.936668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-80caf3e4-e303-4efc-88d8-94e455618921 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:38.951437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-fbb8d0c8-b051-48cf-afca-0cd0e5bc6d86 req-658991f3-ebbc-45b5-8e02-5587f2d579b2 service nova] Creating event network-vif-deleted:01db6eee-31a9-4f2e-be4c-31e4d1b8441b for instance c2351ed2-58ed-4953-b7a6-5c4773b2598a on hv-cinder-85124 Jul 27 20:42:38.955832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-80caf3e4-e303-4efc-88d8-94e455618921 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.215404 Jul 27 20:42:38.956746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 969/2080] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:38 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:38.960980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-fbb8d0c8-b051-48cf-afca-0cd0e5bc6d86 req-658991f3-ebbc-45b5-8e02-5587f2d579b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054746 Jul 27 20:42:38.961915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1112/2081] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:42:39.146346 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-13469969-0004-456f-84ef-0ed7e386ca62 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:39.146866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-13469969-0004-456f-84ef-0ed7e386ca62 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:39.153362 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13469969-0004-456f-84ef-0ed7e386ca62 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.153807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13469969-0004-456f-84ef-0ed7e386ca62 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.154572 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13469969-0004-456f-84ef-0ed7e386ca62 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.155049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13469969-0004-456f-84ef-0ed7e386ca62 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.217212 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-13469969-0004-456f-84ef-0ed7e386ca62 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:39.225609 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-13469969-0004-456f-84ef-0ed7e386ca62 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083229 Jul 27 20:42:39.226180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 970/2082] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:39 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:39.668357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:39.669127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:39.675772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.682335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.682335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.682335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.682335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:39.711041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.711485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.711934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lazy-loading 'fault' on Instance uuid c2351ed2-58ed-4953-b7a6-5c4773b2598a {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:42:39.754898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:39.763640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:39.765524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caca4eade01642af9322aa72f7443726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74675480e734145a1692641342c3e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:39.766680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b8d36d65-c304-408f-9bf6-c2992b617822 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 200 len: 1371 microversion: 2.20 time: 0.103174 Jul 27 20:42:39.767287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1113/2083] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:39 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:39.977640 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1c6d24d6-ee91-4538-92ab-090533b2ec10 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:39.978261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1c6d24d6-ee91-4538-92ab-090533b2ec10 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:39.985058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c6d24d6-ee91-4538-92ab-090533b2ec10 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.985511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c6d24d6-ee91-4538-92ab-090533b2ec10 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.986272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c6d24d6-ee91-4538-92ab-090533b2ec10 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.986711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c6d24d6-ee91-4538-92ab-090533b2ec10 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:40.117865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1c6d24d6-ee91-4538-92ab-090533b2ec10 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:40.127751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1c6d24d6-ee91-4538-92ab-090533b2ec10 tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.153973 Jul 27 20:42:40.128322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 971/2084] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:39 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:40.246453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2dc0e05c-ac34-4188-8b2a-42a854333155 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:40.247688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2dc0e05c-ac34-4188-8b2a-42a854333155 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:40.253897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2dc0e05c-ac34-4188-8b2a-42a854333155 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:40.254349 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2dc0e05c-ac34-4188-8b2a-42a854333155 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:40.255110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2dc0e05c-ac34-4188-8b2a-42a854333155 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:40.255547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2dc0e05c-ac34-4188-8b2a-42a854333155 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:40.315229 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2dc0e05c-ac34-4188-8b2a-42a854333155 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:40.323197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2dc0e05c-ac34-4188-8b2a-42a854333155 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080718 Jul 27 20:42:40.323686 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1114/2085] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:40 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:40.789223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:40.789842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:40.795874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:40.796326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:40.797147 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:40.797587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:40.812869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a HTTP/1.1 Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:42:40.814472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:40.816169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': 'c2351ed2-58ed-4953-b7a6-5c4773b2598a'} Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:42:40.817062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:40.818615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:40.820058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 404 to user: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:42:40.820058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d2cd995e-9c2a-4b05-8dae-fc509b2e242f tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 404 len: 111 microversion: 2.20 time: 0.030570 Jul 27 20:42:40.820058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 972/2086] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:40 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:42:40.825313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-75bf436b-f1ef-4afe-a51c-a58873f8b46d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '.version_select at 0x7f35ca385e50>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:40.906688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-75bf436b-f1ef-4afe-a51c-a58873f8b46d tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717186761" status: 204 len: 0 microversion: 2.20 time: 0.085872 Jul 27 20:42:40.907262 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1115/2087] 10.222.0.47 () {60 vars in 1262 bytes} [Wed Jul 27 20:42:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717186761 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 20:42:41.148749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-065b26e5-d339-4f6d-a7cf-73a85615801f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:41.149366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-065b26e5-d339-4f6d-a7cf-73a85615801f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] [instance: 6d9fd4e2-6f6c-4826-96f5-09b52de8f200] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:41.156716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-065b26e5-d339-4f6d-a7cf-73a85615801f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.157167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-065b26e5-d339-4f6d-a7cf-73a85615801f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.157961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-065b26e5-d339-4f6d-a7cf-73a85615801f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.158881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-065b26e5-d339-4f6d-a7cf-73a85615801f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.297281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-065b26e5-d339-4f6d-a7cf-73a85615801f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2d8cdf0e0d48f4a89a0e85694c3372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8054a20f70e6408ebe06c787887d0b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:41.306164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-065b26e5-d339-4f6d-a7cf-73a85615801f tempest-VolumesSnapshotTestJSON-1671077269 tempest-VolumesSnapshotTestJSON-1671077269-project] 10.222.0.47 "GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200" status: 200 len: 1560 microversion: 2.1 time: 0.161221 Jul 27 20:42:41.311295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 973/2088] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:41 2022] GET /compute/v2.1/servers/6d9fd4e2-6f6c-4826-96f5-09b52de8f200 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:41.350429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-11ef6d25-6f6b-47e5-909b-2dcf319f2d09 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:41.350429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-11ef6d25-6f6b-47e5-909b-2dcf319f2d09 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:41.354301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11ef6d25-6f6b-47e5-909b-2dcf319f2d09 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.355008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11ef6d25-6f6b-47e5-909b-2dcf319f2d09 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.355493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11ef6d25-6f6b-47e5-909b-2dcf319f2d09 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.357749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11ef6d25-6f6b-47e5-909b-2dcf319f2d09 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.475785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-11ef6d25-6f6b-47e5-909b-2dcf319f2d09 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:41.486106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-11ef6d25-6f6b-47e5-909b-2dcf319f2d09 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.145119 Jul 27 20:42:41.486730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1116/2089] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:41 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:41.655233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:41.655731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:41.661718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.662173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.662942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.663385 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.677384 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a HTTP/1.1 Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:42:41.678989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.680778 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': 'c2351ed2-58ed-4953-b7a6-5c4773b2598a'} Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:42:41.685179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.686538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.687907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 404 to user: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:42:41.687907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bb0964a5-6766-43dd-8727-c596e977f4b4 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 404 len: 111 microversion: 2.20 time: 0.029042 Jul 27 20:42:41.687907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 974/2090] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 20:42:41 2022] DELETE /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 20:42:41.690082 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:41.690694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: c2351ed2-58ed-4953-b7a6-5c4773b2598a] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:41.696900 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.697385 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.698144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.698579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.711766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a HTTP/1.1 Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:42:41.713495 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.715127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': 'c2351ed2-58ed-4953-b7a6-5c4773b2598a'} Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:42:41.716097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. Jul 27 20:42:41.717392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:42:41.718565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 404 to user: Instance c2351ed2-58ed-4953-b7a6-5c4773b2598a could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:42:41.718565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6de15007-c15e-4816-ad0c-0038ac1cd632 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a" status: 404 len: 111 microversion: 2.20 time: 0.029099 Jul 27 20:42:41.718565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1117/2091] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:41 2022] GET /compute/v2.1/servers/c2351ed2-58ed-4953-b7a6-5c4773b2598a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:42:42.508348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-290074b6-c19f-4801-b292-6593d769bd2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:42.509192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-290074b6-c19f-4801-b292-6593d769bd2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:42.515774 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-290074b6-c19f-4801-b292-6593d769bd2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:42.516226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-290074b6-c19f-4801-b292-6593d769bd2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:42.517030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-290074b6-c19f-4801-b292-6593d769bd2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:42.517466 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-290074b6-c19f-4801-b292-6593d769bd2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:42.623438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-290074b6-c19f-4801-b292-6593d769bd2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:42.631635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-290074b6-c19f-4801-b292-6593d769bd2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.127175 Jul 27 20:42:42.632221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 975/2092] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:42 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:43.015639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-1699fc76-21e7-4129-a217-72b4a4c1c5bc req-66f46242-2a92-479f-b477-6e81969f5742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9fd4e2-6f6c-4826-96f5-09b52de8f200", "name": "network-vif-deleted", "tag": "4c21a1d5-3c73-4b7d-88c0-88411bae4727"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:42:43.021127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:43.028600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-1699fc76-21e7-4129-a217-72b4a4c1c5bc req-66f46242-2a92-479f-b477-6e81969f5742 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:43.028600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-1699fc76-21e7-4129-a217-72b4a4c1c5bc req-66f46242-2a92-479f-b477-6e81969f5742 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:43.038106 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-1699fc76-21e7-4129-a217-72b4a4c1c5bc req-66f46242-2a92-479f-b477-6e81969f5742 service nova] Creating event network-vif-deleted:4c21a1d5-3c73-4b7d-88c0-88411bae4727 for instance 6d9fd4e2-6f6c-4826-96f5-09b52de8f200 on hv-cinder-85124 Jul 27 20:42:43.043107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-1699fc76-21e7-4129-a217-72b4a4c1c5bc req-66f46242-2a92-479f-b477-6e81969f5742 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031329 Jul 27 20:42:43.043681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1118/2093] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:42:43.653747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d2e85089-22fe-46fd-8656-78bd24aab6ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:43.654287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d2e85089-22fe-46fd-8656-78bd24aab6ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:43.660809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2e85089-22fe-46fd-8656-78bd24aab6ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:43.661295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2e85089-22fe-46fd-8656-78bd24aab6ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:43.662054 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2e85089-22fe-46fd-8656-78bd24aab6ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:43.662494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2e85089-22fe-46fd-8656-78bd24aab6ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:43.725937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d2e85089-22fe-46fd-8656-78bd24aab6ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:43.733907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d2e85089-22fe-46fd-8656-78bd24aab6ae tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084190 Jul 27 20:42:43.734478 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 976/2094] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:43 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:44.755769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a57f72d8-2bb6-4b33-bf6f-ac1cfb15a241 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:44.756505 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a57f72d8-2bb6-4b33-bf6f-ac1cfb15a241 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:44.764005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a57f72d8-2bb6-4b33-bf6f-ac1cfb15a241 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:44.764496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a57f72d8-2bb6-4b33-bf6f-ac1cfb15a241 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:44.765260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a57f72d8-2bb6-4b33-bf6f-ac1cfb15a241 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:44.765698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a57f72d8-2bb6-4b33-bf6f-ac1cfb15a241 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:44.828937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a57f72d8-2bb6-4b33-bf6f-ac1cfb15a241 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:44.836814 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a57f72d8-2bb6-4b33-bf6f-ac1cfb15a241 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085302 Jul 27 20:42:44.837381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1119/2095] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:44 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:45.857893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8b8cbe0e-1a96-437f-8a39-52185cbd6f18 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:45.858511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8b8cbe0e-1a96-437f-8a39-52185cbd6f18 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:45.864772 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b8cbe0e-1a96-437f-8a39-52185cbd6f18 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:45.865233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b8cbe0e-1a96-437f-8a39-52185cbd6f18 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:45.865994 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b8cbe0e-1a96-437f-8a39-52185cbd6f18 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:45.866430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b8cbe0e-1a96-437f-8a39-52185cbd6f18 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:45.925978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8b8cbe0e-1a96-437f-8a39-52185cbd6f18 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:45.933902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8b8cbe0e-1a96-437f-8a39-52185cbd6f18 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080557 Jul 27 20:42:45.934464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 977/2096] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:45 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:46.954283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-49645aee-944e-4d2e-ba49-21224a694f9f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:46.954809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49645aee-944e-4d2e-ba49-21224a694f9f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:46.961345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49645aee-944e-4d2e-ba49-21224a694f9f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:46.961806 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49645aee-944e-4d2e-ba49-21224a694f9f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:46.962559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49645aee-944e-4d2e-ba49-21224a694f9f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:46.962994 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49645aee-944e-4d2e-ba49-21224a694f9f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:47.023362 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49645aee-944e-4d2e-ba49-21224a694f9f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:47.031402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-49645aee-944e-4d2e-ba49-21224a694f9f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081074 Jul 27 20:42:47.031960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1120/2097] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:46 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:48.052634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4af87954-98f4-49d2-9579-01cc4b055038 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:48.053338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4af87954-98f4-49d2-9579-01cc4b055038 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:48.060411 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4af87954-98f4-49d2-9579-01cc4b055038 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:48.060972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4af87954-98f4-49d2-9579-01cc4b055038 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:48.061716 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4af87954-98f4-49d2-9579-01cc4b055038 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:48.062145 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4af87954-98f4-49d2-9579-01cc4b055038 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:48.124818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4af87954-98f4-49d2-9579-01cc4b055038 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:48.132757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4af87954-98f4-49d2-9579-01cc4b055038 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084007 Jul 27 20:42:48.133320 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 978/2098] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:48 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:49.154042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aac47569-9dab-4cb9-956e-838e982fdd5a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:49.154654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aac47569-9dab-4cb9-956e-838e982fdd5a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:49.161195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aac47569-9dab-4cb9-956e-838e982fdd5a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:49.161641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aac47569-9dab-4cb9-956e-838e982fdd5a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:49.162393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aac47569-9dab-4cb9-956e-838e982fdd5a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:49.162821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aac47569-9dab-4cb9-956e-838e982fdd5a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:49.229572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aac47569-9dab-4cb9-956e-838e982fdd5a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:49.237774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aac47569-9dab-4cb9-956e-838e982fdd5a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.087682 Jul 27 20:42:49.238464 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1121/2099] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:49 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:50.259740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2097f838-024e-4f9f-80e3-0463658d0959 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:50.260407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2097f838-024e-4f9f-80e3-0463658d0959 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:50.267033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2097f838-024e-4f9f-80e3-0463658d0959 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:50.267481 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2097f838-024e-4f9f-80e3-0463658d0959 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:50.268232 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2097f838-024e-4f9f-80e3-0463658d0959 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:50.268699 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2097f838-024e-4f9f-80e3-0463658d0959 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:50.586241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2097f838-024e-4f9f-80e3-0463658d0959 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:50.594282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2097f838-024e-4f9f-80e3-0463658d0959 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.338488 Jul 27 20:42:50.594864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 979/2100] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:50 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:51.614655 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-001f60a0-5e34-4a70-a7cb-1d4e96e1a769 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:51.615191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-001f60a0-5e34-4a70-a7cb-1d4e96e1a769 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:51.622528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-001f60a0-5e34-4a70-a7cb-1d4e96e1a769 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:51.623585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-001f60a0-5e34-4a70-a7cb-1d4e96e1a769 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:51.624330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-001f60a0-5e34-4a70-a7cb-1d4e96e1a769 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:51.624787 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-001f60a0-5e34-4a70-a7cb-1d4e96e1a769 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:51.685242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-001f60a0-5e34-4a70-a7cb-1d4e96e1a769 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:51.692980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-001f60a0-5e34-4a70-a7cb-1d4e96e1a769 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082175 Jul 27 20:42:51.693545 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1122/2101] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:51 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:52.713042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e9a28713-eb51-4b07-a627-cf4b82a04752 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:52.713655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e9a28713-eb51-4b07-a627-cf4b82a04752 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:52.720204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9a28713-eb51-4b07-a627-cf4b82a04752 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:52.720697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9a28713-eb51-4b07-a627-cf4b82a04752 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:52.721492 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9a28713-eb51-4b07-a627-cf4b82a04752 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:52.721929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e9a28713-eb51-4b07-a627-cf4b82a04752 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:52.783145 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e9a28713-eb51-4b07-a627-cf4b82a04752 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:52.791018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e9a28713-eb51-4b07-a627-cf4b82a04752 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081796 Jul 27 20:42:52.791615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 980/2102] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:52 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:53.812038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-72c7002e-dc5c-44f5-a8c7-01b6acbd252f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:53.812707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-72c7002e-dc5c-44f5-a8c7-01b6acbd252f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:53.819179 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72c7002e-dc5c-44f5-a8c7-01b6acbd252f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:53.819632 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72c7002e-dc5c-44f5-a8c7-01b6acbd252f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:53.820401 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72c7002e-dc5c-44f5-a8c7-01b6acbd252f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:53.820846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72c7002e-dc5c-44f5-a8c7-01b6acbd252f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:53.885908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-72c7002e-dc5c-44f5-a8c7-01b6acbd252f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:53.893820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-72c7002e-dc5c-44f5-a8c7-01b6acbd252f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085606 Jul 27 20:42:53.894394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1123/2103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:53 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:54.914390 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c8e8c620-d62b-4c05-8cb1-6382c0d9f08b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:54.921210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c8e8c620-d62b-4c05-8cb1-6382c0d9f08b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:54.922121 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8e8c620-d62b-4c05-8cb1-6382c0d9f08b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:54.922577 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8e8c620-d62b-4c05-8cb1-6382c0d9f08b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:54.923369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8e8c620-d62b-4c05-8cb1-6382c0d9f08b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:54.923807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8e8c620-d62b-4c05-8cb1-6382c0d9f08b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:54.986641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c8e8c620-d62b-4c05-8cb1-6382c0d9f08b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:54.995135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c8e8c620-d62b-4c05-8cb1-6382c0d9f08b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084660 Jul 27 20:42:54.995704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 981/2104] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:54 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:56.015586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cafb6283-163f-4bb9-b2ac-9b655920c631 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:56.016220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cafb6283-163f-4bb9-b2ac-9b655920c631 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:56.022430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cafb6283-163f-4bb9-b2ac-9b655920c631 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:56.022905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cafb6283-163f-4bb9-b2ac-9b655920c631 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:56.023653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cafb6283-163f-4bb9-b2ac-9b655920c631 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:56.024076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cafb6283-163f-4bb9-b2ac-9b655920c631 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:56.084081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cafb6283-163f-4bb9-b2ac-9b655920c631 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:56.091965 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cafb6283-163f-4bb9-b2ac-9b655920c631 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080327 Jul 27 20:42:56.092571 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1124/2105] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:56 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:57.112991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ae53574a-0bc3-4852-b65b-f303f659c81f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:57.113610 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ae53574a-0bc3-4852-b65b-f303f659c81f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:57.120674 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae53574a-0bc3-4852-b65b-f303f659c81f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:57.121119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae53574a-0bc3-4852-b65b-f303f659c81f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:57.121877 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae53574a-0bc3-4852-b65b-f303f659c81f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:57.122319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae53574a-0bc3-4852-b65b-f303f659c81f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:57.181838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ae53574a-0bc3-4852-b65b-f303f659c81f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:57.189730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ae53574a-0bc3-4852-b65b-f303f659c81f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080638 Jul 27 20:42:57.190298 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 982/2106] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:57 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:58.211206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-65c7ba48-4c12-4129-b4ae-73e1b66e5cba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:58.211882 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-65c7ba48-4c12-4129-b4ae-73e1b66e5cba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:58.218368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65c7ba48-4c12-4129-b4ae-73e1b66e5cba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:58.218815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65c7ba48-4c12-4129-b4ae-73e1b66e5cba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:58.219567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65c7ba48-4c12-4129-b4ae-73e1b66e5cba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:58.220003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-65c7ba48-4c12-4129-b4ae-73e1b66e5cba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:58.279544 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-65c7ba48-4c12-4129-b4ae-73e1b66e5cba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:58.287381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-65c7ba48-4c12-4129-b4ae-73e1b66e5cba tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080152 Jul 27 20:42:58.287952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1125/2107] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:58 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:59.308174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-84f5c5bb-4370-4823-ad57-a8fb2f5e185d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:59.308809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-84f5c5bb-4370-4823-ad57-a8fb2f5e185d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:59.315283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84f5c5bb-4370-4823-ad57-a8fb2f5e185d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:59.315734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84f5c5bb-4370-4823-ad57-a8fb2f5e185d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:59.316531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84f5c5bb-4370-4823-ad57-a8fb2f5e185d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:59.316969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84f5c5bb-4370-4823-ad57-a8fb2f5e185d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:59.380173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-84f5c5bb-4370-4823-ad57-a8fb2f5e185d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:59.387958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-84f5c5bb-4370-4823-ad57-a8fb2f5e185d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083647 Jul 27 20:42:59.388552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 983/2108] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:59 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:00.412215 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e885ab6c-404f-41aa-b06f-4e140a03c548 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:00.412887 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e885ab6c-404f-41aa-b06f-4e140a03c548 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:00.419894 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e885ab6c-404f-41aa-b06f-4e140a03c548 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:00.420343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e885ab6c-404f-41aa-b06f-4e140a03c548 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:00.421129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e885ab6c-404f-41aa-b06f-4e140a03c548 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:00.421562 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e885ab6c-404f-41aa-b06f-4e140a03c548 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:00.481732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e885ab6c-404f-41aa-b06f-4e140a03c548 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:00.489677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e885ab6c-404f-41aa-b06f-4e140a03c548 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081325 Jul 27 20:43:00.490247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1126/2109] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:00 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:01.511659 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-32c6f586-ac46-4b16-ae86-6b60845d8ec4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:01.512265 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-32c6f586-ac46-4b16-ae86-6b60845d8ec4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:01.519255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-32c6f586-ac46-4b16-ae86-6b60845d8ec4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:01.519744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-32c6f586-ac46-4b16-ae86-6b60845d8ec4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:01.520521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-32c6f586-ac46-4b16-ae86-6b60845d8ec4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:01.520951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-32c6f586-ac46-4b16-ae86-6b60845d8ec4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:01.581312 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-32c6f586-ac46-4b16-ae86-6b60845d8ec4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:01.589259 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-32c6f586-ac46-4b16-ae86-6b60845d8ec4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082171 Jul 27 20:43:01.589829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 984/2110] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:01 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:02.609490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-39b4b8c8-63ca-413c-8d30-00bec4b0079f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:02.610035 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39b4b8c8-63ca-413c-8d30-00bec4b0079f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:02.616443 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b4b8c8-63ca-413c-8d30-00bec4b0079f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:02.616889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b4b8c8-63ca-413c-8d30-00bec4b0079f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:02.617630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b4b8c8-63ca-413c-8d30-00bec4b0079f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:02.618053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b4b8c8-63ca-413c-8d30-00bec4b0079f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:02.678299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-39b4b8c8-63ca-413c-8d30-00bec4b0079f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:02.686044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-39b4b8c8-63ca-413c-8d30-00bec4b0079f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080462 Jul 27 20:43:02.686609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1127/2111] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:02 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:03.707562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-736db88e-633f-4e4e-a5bb-d150678d446a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:03.708133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-736db88e-633f-4e4e-a5bb-d150678d446a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:03.715366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-736db88e-633f-4e4e-a5bb-d150678d446a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:03.715809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-736db88e-633f-4e4e-a5bb-d150678d446a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:03.716584 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-736db88e-633f-4e4e-a5bb-d150678d446a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:03.717015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-736db88e-633f-4e4e-a5bb-d150678d446a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:03.779029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-736db88e-633f-4e4e-a5bb-d150678d446a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:03.786862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-736db88e-633f-4e4e-a5bb-d150678d446a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083569 Jul 27 20:43:03.787424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 985/2112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:03 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:04.807659 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3e3c8f5e-1553-4d2c-943a-21a5174ad1fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:04.808274 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3e3c8f5e-1553-4d2c-943a-21a5174ad1fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:04.814804 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e3c8f5e-1553-4d2c-943a-21a5174ad1fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:04.815253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e3c8f5e-1553-4d2c-943a-21a5174ad1fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:04.816005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e3c8f5e-1553-4d2c-943a-21a5174ad1fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:04.816470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e3c8f5e-1553-4d2c-943a-21a5174ad1fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:04.878747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3e3c8f5e-1553-4d2c-943a-21a5174ad1fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:04.886614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3e3c8f5e-1553-4d2c-943a-21a5174ad1fb tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083352 Jul 27 20:43:04.887187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1128/2113] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:04 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:05.907990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9e1a63b4-908d-408f-9d23-ea9ae6b7ca5f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:05.908636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9e1a63b4-908d-408f-9d23-ea9ae6b7ca5f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:05.915179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e1a63b4-908d-408f-9d23-ea9ae6b7ca5f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:05.915634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e1a63b4-908d-408f-9d23-ea9ae6b7ca5f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:05.916410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e1a63b4-908d-408f-9d23-ea9ae6b7ca5f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:05.916862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e1a63b4-908d-408f-9d23-ea9ae6b7ca5f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:05.979009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9e1a63b4-908d-408f-9d23-ea9ae6b7ca5f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:05.986868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9e1a63b4-908d-408f-9d23-ea9ae6b7ca5f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082761 Jul 27 20:43:05.987444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 986/2114] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:05 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:07.009395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d47f812f-cef2-4542-a7c2-9202069eba1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:07.010570 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d47f812f-cef2-4542-a7c2-9202069eba1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:07.017335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d47f812f-cef2-4542-a7c2-9202069eba1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:07.017793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d47f812f-cef2-4542-a7c2-9202069eba1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:07.018552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d47f812f-cef2-4542-a7c2-9202069eba1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:07.018988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d47f812f-cef2-4542-a7c2-9202069eba1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:07.078842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d47f812f-cef2-4542-a7c2-9202069eba1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:07.086675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d47f812f-cef2-4542-a7c2-9202069eba1d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081422 Jul 27 20:43:07.087252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1129/2115] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:07 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:08.107752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-07853249-7d2b-44d7-940f-45cb98ad7b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:08.108642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-07853249-7d2b-44d7-940f-45cb98ad7b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:08.110913 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:08.115870 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-07853249-7d2b-44d7-940f-45cb98ad7b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:08.116322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-07853249-7d2b-44d7-940f-45cb98ad7b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:08.117105 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-07853249-7d2b-44d7-940f-45cb98ad7b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:08.118195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-07853249-7d2b-44d7-940f-45cb98ad7b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:08.124392 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:08.189978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-07853249-7d2b-44d7-940f-45cb98ad7b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:08.197852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-07853249-7d2b-44d7-940f-45cb98ad7b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.094439 Jul 27 20:43:08.198412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 987/2116] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:08 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:09.217448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f7672da7-8468-4cdc-badf-fce0ae2d5bd6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:09.218063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f7672da7-8468-4cdc-badf-fce0ae2d5bd6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:09.224576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7672da7-8468-4cdc-badf-fce0ae2d5bd6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:09.225030 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7672da7-8468-4cdc-badf-fce0ae2d5bd6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:09.225781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7672da7-8468-4cdc-badf-fce0ae2d5bd6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:09.226217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7672da7-8468-4cdc-badf-fce0ae2d5bd6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:09.286313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f7672da7-8468-4cdc-badf-fce0ae2d5bd6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:09.294115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f7672da7-8468-4cdc-badf-fce0ae2d5bd6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080563 Jul 27 20:43:09.294739 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1130/2117] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:09 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:10.315543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e2fce94e-88e6-4b50-a5a6-46ec1a727018 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:10.316186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e2fce94e-88e6-4b50-a5a6-46ec1a727018 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:10.322723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2fce94e-88e6-4b50-a5a6-46ec1a727018 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:10.323160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2fce94e-88e6-4b50-a5a6-46ec1a727018 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:10.323945 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2fce94e-88e6-4b50-a5a6-46ec1a727018 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:10.324398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2fce94e-88e6-4b50-a5a6-46ec1a727018 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:10.385315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e2fce94e-88e6-4b50-a5a6-46ec1a727018 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:10.393120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e2fce94e-88e6-4b50-a5a6-46ec1a727018 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081845 Jul 27 20:43:10.393689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 988/2118] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:10 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:11.412933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b79a1fe9-0e2c-4acc-bd6e-fc769ac9c436 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:11.413537 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b79a1fe9-0e2c-4acc-bd6e-fc769ac9c436 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:11.420646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b79a1fe9-0e2c-4acc-bd6e-fc769ac9c436 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:11.421087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b79a1fe9-0e2c-4acc-bd6e-fc769ac9c436 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:11.421861 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b79a1fe9-0e2c-4acc-bd6e-fc769ac9c436 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:11.422303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b79a1fe9-0e2c-4acc-bd6e-fc769ac9c436 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:11.424945 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=96 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:11.483345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b79a1fe9-0e2c-4acc-bd6e-fc769ac9c436 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:11.491269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b79a1fe9-0e2c-4acc-bd6e-fc769ac9c436 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082160 Jul 27 20:43:11.491835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1131/2119] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:11 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:12.512975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a394d008-f619-4d48-8378-171fe701b048 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:12.513588 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a394d008-f619-4d48-8378-171fe701b048 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:12.520467 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a394d008-f619-4d48-8378-171fe701b048 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:12.520924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a394d008-f619-4d48-8378-171fe701b048 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:12.521687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a394d008-f619-4d48-8378-171fe701b048 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:12.522123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a394d008-f619-4d48-8378-171fe701b048 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:12.585051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a394d008-f619-4d48-8378-171fe701b048 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:12.593182 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a394d008-f619-4d48-8378-171fe701b048 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084094 Jul 27 20:43:12.593760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 989/2120] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:12 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:13.613681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8dbdcc47-caac-4e36-bdda-42ca4864c1c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:13.614217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8dbdcc47-caac-4e36-bdda-42ca4864c1c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:13.621559 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dbdcc47-caac-4e36-bdda-42ca4864c1c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:13.622011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dbdcc47-caac-4e36-bdda-42ca4864c1c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:13.622764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dbdcc47-caac-4e36-bdda-42ca4864c1c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:13.623199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dbdcc47-caac-4e36-bdda-42ca4864c1c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:13.683259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8dbdcc47-caac-4e36-bdda-42ca4864c1c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:13.691191 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8dbdcc47-caac-4e36-bdda-42ca4864c1c5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081479 Jul 27 20:43:13.696892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1132/2121] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:13 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:14.712190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aad2135f-5eea-4955-88d7-ac765c3947f6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:14.712837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aad2135f-5eea-4955-88d7-ac765c3947f6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:14.719006 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad2135f-5eea-4955-88d7-ac765c3947f6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:14.719456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad2135f-5eea-4955-88d7-ac765c3947f6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:14.720212 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad2135f-5eea-4955-88d7-ac765c3947f6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:14.720683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aad2135f-5eea-4955-88d7-ac765c3947f6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:14.779916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aad2135f-5eea-4955-88d7-ac765c3947f6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:14.787715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aad2135f-5eea-4955-88d7-ac765c3947f6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.079391 Jul 27 20:43:14.788309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 990/2122] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:14 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:15.808790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-74d4d308-bf88-40b6-9cad-80cef3776472 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:15.809403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-74d4d308-bf88-40b6-9cad-80cef3776472 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:15.811780 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=30 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:15.816583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74d4d308-bf88-40b6-9cad-80cef3776472 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:15.817036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74d4d308-bf88-40b6-9cad-80cef3776472 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:15.817791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74d4d308-bf88-40b6-9cad-80cef3776472 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:15.818224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74d4d308-bf88-40b6-9cad-80cef3776472 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:15.879420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-74d4d308-bf88-40b6-9cad-80cef3776472 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:15.887332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-74d4d308-bf88-40b6-9cad-80cef3776472 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082433 Jul 27 20:43:15.887902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1133/2123] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:15 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:16.908714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a404d71a-abd5-4148-bc39-5d174dc518ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:16.909261 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a404d71a-abd5-4148-bc39-5d174dc518ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:16.916333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a404d71a-abd5-4148-bc39-5d174dc518ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:16.916819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a404d71a-abd5-4148-bc39-5d174dc518ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:16.917570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a404d71a-abd5-4148-bc39-5d174dc518ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:16.918003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a404d71a-abd5-4148-bc39-5d174dc518ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:16.980896 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a404d71a-abd5-4148-bc39-5d174dc518ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:16.988702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a404d71a-abd5-4148-bc39-5d174dc518ff tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083961 Jul 27 20:43:16.989279 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 991/2124] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:16 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:18.010755 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4688f7bb-1026-481b-aa3e-46cffdad9e6f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:18.011394 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4688f7bb-1026-481b-aa3e-46cffdad9e6f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:18.017988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4688f7bb-1026-481b-aa3e-46cffdad9e6f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:18.019183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4688f7bb-1026-481b-aa3e-46cffdad9e6f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:18.019293 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4688f7bb-1026-481b-aa3e-46cffdad9e6f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:18.019681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4688f7bb-1026-481b-aa3e-46cffdad9e6f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:18.080343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4688f7bb-1026-481b-aa3e-46cffdad9e6f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:18.088181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4688f7bb-1026-481b-aa3e-46cffdad9e6f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082153 Jul 27 20:43:18.088781 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1134/2125] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:18 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:19.109292 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d0a06837-7b1b-4a61-ab31-954b3e5c4f7c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:19.109910 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d0a06837-7b1b-4a61-ab31-954b3e5c4f7c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:19.116692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0a06837-7b1b-4a61-ab31-954b3e5c4f7c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:19.117246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0a06837-7b1b-4a61-ab31-954b3e5c4f7c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:19.118016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0a06837-7b1b-4a61-ab31-954b3e5c4f7c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:19.118740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0a06837-7b1b-4a61-ab31-954b3e5c4f7c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:19.180304 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0a06837-7b1b-4a61-ab31-954b3e5c4f7c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:19.188921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d0a06837-7b1b-4a61-ab31-954b3e5c4f7c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083674 Jul 27 20:43:19.189491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 992/2126] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:19 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:20.209444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-25c95ece-9c93-4eeb-9977-a1540e71c029 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:20.209980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-25c95ece-9c93-4eeb-9977-a1540e71c029 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:20.217011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25c95ece-9c93-4eeb-9977-a1540e71c029 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:20.217462 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25c95ece-9c93-4eeb-9977-a1540e71c029 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:20.218218 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25c95ece-9c93-4eeb-9977-a1540e71c029 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:20.218654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-25c95ece-9c93-4eeb-9977-a1540e71c029 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:20.281829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-25c95ece-9c93-4eeb-9977-a1540e71c029 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:20.289798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-25c95ece-9c93-4eeb-9977-a1540e71c029 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084285 Jul 27 20:43:20.290367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1135/2127] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:20 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:21.311144 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4ec3e22f-68a4-47db-a624-fbf891b112b9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:21.311756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4ec3e22f-68a4-47db-a624-fbf891b112b9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:21.318245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ec3e22f-68a4-47db-a624-fbf891b112b9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:21.318695 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ec3e22f-68a4-47db-a624-fbf891b112b9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:21.319448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ec3e22f-68a4-47db-a624-fbf891b112b9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:21.319879 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ec3e22f-68a4-47db-a624-fbf891b112b9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:21.468775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4ec3e22f-68a4-47db-a624-fbf891b112b9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:21.476888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4ec3e22f-68a4-47db-a624-fbf891b112b9 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.169456 Jul 27 20:43:21.477463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 993/2128] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:21 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:22.498304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5a2f8543-e542-4339-a1ae-e332a63bea37 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:22.499032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5a2f8543-e542-4339-a1ae-e332a63bea37 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:22.505578 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a2f8543-e542-4339-a1ae-e332a63bea37 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:22.506028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a2f8543-e542-4339-a1ae-e332a63bea37 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:22.506774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a2f8543-e542-4339-a1ae-e332a63bea37 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:22.507203 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a2f8543-e542-4339-a1ae-e332a63bea37 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:22.624565 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a2f8543-e542-4339-a1ae-e332a63bea37 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:22.632547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5a2f8543-e542-4339-a1ae-e332a63bea37 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.138830 Jul 27 20:43:22.633113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1136/2129] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:22 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:23.653317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7fb841c1-8384-46e3-a461-479cd784a99b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:23.653893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7fb841c1-8384-46e3-a461-479cd784a99b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:23.660286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fb841c1-8384-46e3-a461-479cd784a99b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:23.660909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fb841c1-8384-46e3-a461-479cd784a99b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:23.661656 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fb841c1-8384-46e3-a461-479cd784a99b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:23.662094 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7fb841c1-8384-46e3-a461-479cd784a99b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:23.721782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7fb841c1-8384-46e3-a461-479cd784a99b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:23.730133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7fb841c1-8384-46e3-a461-479cd784a99b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080320 Jul 27 20:43:23.730718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 994/2130] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:23 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:24.750551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f16b4e7e-07a7-4d5c-ab68-c51237d16cf6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:24.751167 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f16b4e7e-07a7-4d5c-ab68-c51237d16cf6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:24.757677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f16b4e7e-07a7-4d5c-ab68-c51237d16cf6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:24.758123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f16b4e7e-07a7-4d5c-ab68-c51237d16cf6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:24.758873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f16b4e7e-07a7-4d5c-ab68-c51237d16cf6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:24.759338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f16b4e7e-07a7-4d5c-ab68-c51237d16cf6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:24.819508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f16b4e7e-07a7-4d5c-ab68-c51237d16cf6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:24.827445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f16b4e7e-07a7-4d5c-ab68-c51237d16cf6 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081170 Jul 27 20:43:24.828015 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1137/2131] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:24 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:25.847631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2e3880bc-d92c-4f27-ad8f-75e200562d90 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:25.848238 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2e3880bc-d92c-4f27-ad8f-75e200562d90 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:25.855393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e3880bc-d92c-4f27-ad8f-75e200562d90 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:25.855837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e3880bc-d92c-4f27-ad8f-75e200562d90 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:25.856608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e3880bc-d92c-4f27-ad8f-75e200562d90 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:25.857036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e3880bc-d92c-4f27-ad8f-75e200562d90 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:25.919233 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2e3880bc-d92c-4f27-ad8f-75e200562d90 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:25.927017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2e3880bc-d92c-4f27-ad8f-75e200562d90 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083205 Jul 27 20:43:25.927578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 995/2132] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:25 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:26.948330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9408aaaa-4985-419e-8611-571484081b06 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:26.948911 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9408aaaa-4985-419e-8611-571484081b06 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:26.954871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9408aaaa-4985-419e-8611-571484081b06 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:26.955318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9408aaaa-4985-419e-8611-571484081b06 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:26.956068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9408aaaa-4985-419e-8611-571484081b06 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:26.956536 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9408aaaa-4985-419e-8611-571484081b06 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:27.017790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9408aaaa-4985-419e-8611-571484081b06 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:27.025684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9408aaaa-4985-419e-8611-571484081b06 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081455 Jul 27 20:43:27.026490 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1138/2133] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:26 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:28.047205 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2e5049f4-a435-4edc-b276-60ec581a9e31 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:28.047822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2e5049f4-a435-4edc-b276-60ec581a9e31 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:28.054401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e5049f4-a435-4edc-b276-60ec581a9e31 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:28.054854 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e5049f4-a435-4edc-b276-60ec581a9e31 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:28.055614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e5049f4-a435-4edc-b276-60ec581a9e31 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:28.056062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e5049f4-a435-4edc-b276-60ec581a9e31 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:28.116052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2e5049f4-a435-4edc-b276-60ec581a9e31 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:28.124730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2e5049f4-a435-4edc-b276-60ec581a9e31 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081389 Jul 27 20:43:28.125308 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 996/2134] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:28 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:43:29.145160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d9b70f37-7fda-43fd-b1bf-b33c1c008388 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:29.145819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d9b70f37-7fda-43fd-b1bf-b33c1c008388 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:29.152857 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9b70f37-7fda-43fd-b1bf-b33c1c008388 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:29.153297 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9b70f37-7fda-43fd-b1bf-b33c1c008388 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:29.154038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9b70f37-7fda-43fd-b1bf-b33c1c008388 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:29.154463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9b70f37-7fda-43fd-b1bf-b33c1c008388 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:29.214538 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9b70f37-7fda-43fd-b1bf-b33c1c008388 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:29.222205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d9b70f37-7fda-43fd-b1bf-b33c1c008388 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080909 Jul 27 20:43:29.222767 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1139/2135] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:29 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:29.866644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:43:29.867176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:43:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:43:30.243668 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d59d8841-ab79-4aa9-97f2-ac20009cf775 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:30.244277 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d59d8841-ab79-4aa9-97f2-ac20009cf775 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:30.251301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d59d8841-ab79-4aa9-97f2-ac20009cf775 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:30.251749 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d59d8841-ab79-4aa9-97f2-ac20009cf775 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:30.252524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d59d8841-ab79-4aa9-97f2-ac20009cf775 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:30.252964 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d59d8841-ab79-4aa9-97f2-ac20009cf775 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:30.315669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d59d8841-ab79-4aa9-97f2-ac20009cf775 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:30.323623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d59d8841-ab79-4aa9-97f2-ac20009cf775 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084056 Jul 27 20:43:30.324199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 997/2136] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:30 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:31.343206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dfdb86e1-c4ff-49c9-aea4-3ee0e4f62d52 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:31.343819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dfdb86e1-c4ff-49c9-aea4-3ee0e4f62d52 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:31.350329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfdb86e1-c4ff-49c9-aea4-3ee0e4f62d52 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:31.350776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfdb86e1-c4ff-49c9-aea4-3ee0e4f62d52 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:31.351525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfdb86e1-c4ff-49c9-aea4-3ee0e4f62d52 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:31.351987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfdb86e1-c4ff-49c9-aea4-3ee0e4f62d52 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:31.415084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfdb86e1-c4ff-49c9-aea4-3ee0e4f62d52 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:31.423568 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dfdb86e1-c4ff-49c9-aea4-3ee0e4f62d52 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084219 Jul 27 20:43:31.424121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1140/2137] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:31 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:32.443925 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ce4a3fd8-3d8d-48bc-bb9d-bb13714e9fa1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:32.444576 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ce4a3fd8-3d8d-48bc-bb9d-bb13714e9fa1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:32.451378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce4a3fd8-3d8d-48bc-bb9d-bb13714e9fa1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:32.451830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce4a3fd8-3d8d-48bc-bb9d-bb13714e9fa1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:32.452628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce4a3fd8-3d8d-48bc-bb9d-bb13714e9fa1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:32.453068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce4a3fd8-3d8d-48bc-bb9d-bb13714e9fa1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:32.514068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ce4a3fd8-3d8d-48bc-bb9d-bb13714e9fa1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:32.521840 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ce4a3fd8-3d8d-48bc-bb9d-bb13714e9fa1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081842 Jul 27 20:43:32.522405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 998/2138] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:32 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:33.542812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-62fe73c0-4b75-43cb-bfa8-860d7c9f8b89 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:33.543416 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-62fe73c0-4b75-43cb-bfa8-860d7c9f8b89 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:33.551363 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-62fe73c0-4b75-43cb-bfa8-860d7c9f8b89 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:33.551817 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-62fe73c0-4b75-43cb-bfa8-860d7c9f8b89 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:33.552622 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-62fe73c0-4b75-43cb-bfa8-860d7c9f8b89 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:33.553063 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-62fe73c0-4b75-43cb-bfa8-860d7c9f8b89 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:33.574434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:43:33.574625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:43:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d (ip 10.222.0.47) !!! Jul 27 20:43:33.617128 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-62fe73c0-4b75-43cb-bfa8-860d7c9f8b89 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:33.626099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-62fe73c0-4b75-43cb-bfa8-860d7c9f8b89 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.087716 Jul 27 20:43:33.626668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1141/2139] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:33 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:34.647438 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2448a737-1340-46b5-843f-c52766cb5f76 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:34.648050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2448a737-1340-46b5-843f-c52766cb5f76 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:34.657364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2448a737-1340-46b5-843f-c52766cb5f76 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:34.657842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2448a737-1340-46b5-843f-c52766cb5f76 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:34.658597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2448a737-1340-46b5-843f-c52766cb5f76 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:34.659030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2448a737-1340-46b5-843f-c52766cb5f76 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:34.724275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2448a737-1340-46b5-843f-c52766cb5f76 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:34.732086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2448a737-1340-46b5-843f-c52766cb5f76 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.088778 Jul 27 20:43:34.732683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 999/2140] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:34 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:35.752840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2d34b4b6-d50d-437b-9f8b-fca9497e7b74 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:35.753446 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2d34b4b6-d50d-437b-9f8b-fca9497e7b74 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:35.759909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d34b4b6-d50d-437b-9f8b-fca9497e7b74 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:35.760953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d34b4b6-d50d-437b-9f8b-fca9497e7b74 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:35.761715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d34b4b6-d50d-437b-9f8b-fca9497e7b74 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:35.762147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d34b4b6-d50d-437b-9f8b-fca9497e7b74 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:35.823869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d34b4b6-d50d-437b-9f8b-fca9497e7b74 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:35.831572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2d34b4b6-d50d-437b-9f8b-fca9497e7b74 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082585 Jul 27 20:43:35.832164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1142/2141] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:35 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:36.852688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-926a9064-db69-467a-80b4-bf1b543958bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:36.853231 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-926a9064-db69-467a-80b4-bf1b543958bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:36.860331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-926a9064-db69-467a-80b4-bf1b543958bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:36.860810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-926a9064-db69-467a-80b4-bf1b543958bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:36.861558 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-926a9064-db69-467a-80b4-bf1b543958bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:36.861992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-926a9064-db69-467a-80b4-bf1b543958bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:36.923076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-926a9064-db69-467a-80b4-bf1b543958bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:36.930926 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-926a9064-db69-467a-80b4-bf1b543958bc tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082215 Jul 27 20:43:36.931488 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1000/2142] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:36 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:37.952280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-08c57fab-8940-4c60-9285-df4a217e82c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:37.952937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-08c57fab-8940-4c60-9285-df4a217e82c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:37.959377 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08c57fab-8940-4c60-9285-df4a217e82c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:37.959829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08c57fab-8940-4c60-9285-df4a217e82c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:37.960921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08c57fab-8940-4c60-9285-df4a217e82c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:37.961357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08c57fab-8940-4c60-9285-df4a217e82c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:38.021809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-08c57fab-8940-4c60-9285-df4a217e82c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:38.030267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-08c57fab-8940-4c60-9285-df4a217e82c8 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081849 Jul 27 20:43:38.030845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1143/2143] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:37 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:39.050794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-210e00a5-1260-425e-9ab1-6406cf4c4dec tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:39.051441 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-210e00a5-1260-425e-9ab1-6406cf4c4dec tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:39.058683 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-210e00a5-1260-425e-9ab1-6406cf4c4dec tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:39.059130 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-210e00a5-1260-425e-9ab1-6406cf4c4dec tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:39.059938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-210e00a5-1260-425e-9ab1-6406cf4c4dec tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:39.060374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-210e00a5-1260-425e-9ab1-6406cf4c4dec tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:39.062958 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=83 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:39.125249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-210e00a5-1260-425e-9ab1-6406cf4c4dec tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:39.133035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-210e00a5-1260-425e-9ab1-6406cf4c4dec tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.086113 Jul 27 20:43:39.133596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1001/2144] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:39 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:40.154130 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c39b8e98-3427-442f-ae9c-181c31735530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:40.154722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c39b8e98-3427-442f-ae9c-181c31735530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:40.161263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c39b8e98-3427-442f-ae9c-181c31735530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:40.161702 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c39b8e98-3427-442f-ae9c-181c31735530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:40.162439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c39b8e98-3427-442f-ae9c-181c31735530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:40.162869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c39b8e98-3427-442f-ae9c-181c31735530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:40.222250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c39b8e98-3427-442f-ae9c-181c31735530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:40.230532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c39b8e98-3427-442f-ae9c-181c31735530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080234 Jul 27 20:43:40.231101 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1144/2145] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:40 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:41.251135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e36508d2-8c49-4066-991c-c74682788390 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:41.251752 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e36508d2-8c49-4066-991c-c74682788390 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:41.254067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=30 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:41.258832 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e36508d2-8c49-4066-991c-c74682788390 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:41.259284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e36508d2-8c49-4066-991c-c74682788390 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:41.260047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e36508d2-8c49-4066-991c-c74682788390 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:41.260518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e36508d2-8c49-4066-991c-c74682788390 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:41.321218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e36508d2-8c49-4066-991c-c74682788390 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:41.329002 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e36508d2-8c49-4066-991c-c74682788390 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081830 Jul 27 20:43:41.329575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1002/2146] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:41 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:42.349714 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f0e383d4-4c22-4fd6-908e-3564d1f90576 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:42.350322 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f0e383d4-4c22-4fd6-908e-3564d1f90576 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:42.357237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0e383d4-4c22-4fd6-908e-3564d1f90576 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:42.357682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0e383d4-4c22-4fd6-908e-3564d1f90576 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:42.358420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0e383d4-4c22-4fd6-908e-3564d1f90576 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:42.358847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f0e383d4-4c22-4fd6-908e-3564d1f90576 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:42.361331 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=84 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:42.419428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f0e383d4-4c22-4fd6-908e-3564d1f90576 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:42.427231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f0e383d4-4c22-4fd6-908e-3564d1f90576 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081372 Jul 27 20:43:42.427793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1145/2147] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:42 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:43.448350 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1e4d83f9-cdb7-4ad1-86ed-62a30e718cf0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:43.449010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1e4d83f9-cdb7-4ad1-86ed-62a30e718cf0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:43.455471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e4d83f9-cdb7-4ad1-86ed-62a30e718cf0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:43.455927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e4d83f9-cdb7-4ad1-86ed-62a30e718cf0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:43.456756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e4d83f9-cdb7-4ad1-86ed-62a30e718cf0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:43.457198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e4d83f9-cdb7-4ad1-86ed-62a30e718cf0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:43.521660 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1e4d83f9-cdb7-4ad1-86ed-62a30e718cf0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:43.529663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1e4d83f9-cdb7-4ad1-86ed-62a30e718cf0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085156 Jul 27 20:43:43.534051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1003/2148] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:43 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:44.535997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:43:44.536907 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:43:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:43:44.550947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-48c3454c-136d-424a-8374-526dabc63c13 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:44.551551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-48c3454c-136d-424a-8374-526dabc63c13 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:44.557953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48c3454c-136d-424a-8374-526dabc63c13 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:44.558407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48c3454c-136d-424a-8374-526dabc63c13 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:44.559145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48c3454c-136d-424a-8374-526dabc63c13 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:44.559603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-48c3454c-136d-424a-8374-526dabc63c13 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:44.620910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-48c3454c-136d-424a-8374-526dabc63c13 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:44.628931 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-48c3454c-136d-424a-8374-526dabc63c13 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081789 Jul 27 20:43:44.629506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1146/2149] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:44 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:45.650626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d8d18896-5edc-4051-8ec3-467871ffcbb3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:45.651239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d8d18896-5edc-4051-8ec3-467871ffcbb3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:45.657415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d8d18896-5edc-4051-8ec3-467871ffcbb3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:45.657864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d8d18896-5edc-4051-8ec3-467871ffcbb3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:45.658615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d8d18896-5edc-4051-8ec3-467871ffcbb3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:45.659049 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d8d18896-5edc-4051-8ec3-467871ffcbb3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:45.718621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d8d18896-5edc-4051-8ec3-467871ffcbb3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:45.726405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d8d18896-5edc-4051-8ec3-467871ffcbb3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.079868 Jul 27 20:43:45.726966 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1004/2150] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:45 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:46.748634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd945280-2f2f-437e-b497-a601b4b087b2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:46.749241 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fd945280-2f2f-437e-b497-a601b4b087b2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:46.751543 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:46.756284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd945280-2f2f-437e-b497-a601b4b087b2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:46.756757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd945280-2f2f-437e-b497-a601b4b087b2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:46.757494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd945280-2f2f-437e-b497-a601b4b087b2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:46.757918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd945280-2f2f-437e-b497-a601b4b087b2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:46.820216 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd945280-2f2f-437e-b497-a601b4b087b2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:46.827989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd945280-2f2f-437e-b497-a601b4b087b2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083938 Jul 27 20:43:46.828571 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1147/2151] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:46 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:47.848473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-127b2f33-d12b-4e57-9fa7-718592552090 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:47.849034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-127b2f33-d12b-4e57-9fa7-718592552090 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:47.855417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-127b2f33-d12b-4e57-9fa7-718592552090 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:47.855859 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-127b2f33-d12b-4e57-9fa7-718592552090 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:47.856641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-127b2f33-d12b-4e57-9fa7-718592552090 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:47.857073 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-127b2f33-d12b-4e57-9fa7-718592552090 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:47.919947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-127b2f33-d12b-4e57-9fa7-718592552090 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:47.927822 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-127b2f33-d12b-4e57-9fa7-718592552090 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083249 Jul 27 20:43:47.928402 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1005/2152] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:47 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:48.952208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1c318d0c-acc1-402a-8e4d-22ee447c396b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:48.958880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1c318d0c-acc1-402a-8e4d-22ee447c396b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:48.959226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c318d0c-acc1-402a-8e4d-22ee447c396b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:48.959674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c318d0c-acc1-402a-8e4d-22ee447c396b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:48.960442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c318d0c-acc1-402a-8e4d-22ee447c396b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:48.960875 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c318d0c-acc1-402a-8e4d-22ee447c396b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:49.029211 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1c318d0c-acc1-402a-8e4d-22ee447c396b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:49.034228 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1c318d0c-acc1-402a-8e4d-22ee447c396b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085972 Jul 27 20:43:49.034986 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1148/2153] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:48 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:50.055140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8fdfac1e-9c12-42c8-a09f-8737e4afa71f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:50.055781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8fdfac1e-9c12-42c8-a09f-8737e4afa71f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:50.062886 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fdfac1e-9c12-42c8-a09f-8737e4afa71f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:50.063329 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fdfac1e-9c12-42c8-a09f-8737e4afa71f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:50.064083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fdfac1e-9c12-42c8-a09f-8737e4afa71f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:50.064558 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fdfac1e-9c12-42c8-a09f-8737e4afa71f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:50.126316 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8fdfac1e-9c12-42c8-a09f-8737e4afa71f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:50.134019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8fdfac1e-9c12-42c8-a09f-8737e4afa71f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082768 Jul 27 20:43:50.134585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1006/2154] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:50 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:51.154031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-552c42a1-fbd1-4ed8-8ee5-df1c95a9c829 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:51.154646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-552c42a1-fbd1-4ed8-8ee5-df1c95a9c829 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:51.161376 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-552c42a1-fbd1-4ed8-8ee5-df1c95a9c829 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:51.161823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-552c42a1-fbd1-4ed8-8ee5-df1c95a9c829 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:51.162577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-552c42a1-fbd1-4ed8-8ee5-df1c95a9c829 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:51.163009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-552c42a1-fbd1-4ed8-8ee5-df1c95a9c829 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:51.226573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-552c42a1-fbd1-4ed8-8ee5-df1c95a9c829 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:51.235045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-552c42a1-fbd1-4ed8-8ee5-df1c95a9c829 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084946 Jul 27 20:43:51.235618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1149/2155] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:51 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:52.256416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e847c99a-1006-44ff-abc2-a36ed6f79474 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:52.257002 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e847c99a-1006-44ff-abc2-a36ed6f79474 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:52.263977 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e847c99a-1006-44ff-abc2-a36ed6f79474 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:52.264445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e847c99a-1006-44ff-abc2-a36ed6f79474 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:52.265190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e847c99a-1006-44ff-abc2-a36ed6f79474 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:52.265618 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e847c99a-1006-44ff-abc2-a36ed6f79474 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:52.326449 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e847c99a-1006-44ff-abc2-a36ed6f79474 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:52.334283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e847c99a-1006-44ff-abc2-a36ed6f79474 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081693 Jul 27 20:43:52.335081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1007/2156] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:52 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:53.354200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-98667aea-d2eb-47a9-8649-331b690b12f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:53.355388 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-98667aea-d2eb-47a9-8649-331b690b12f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:53.361885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98667aea-d2eb-47a9-8649-331b690b12f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:53.362337 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98667aea-d2eb-47a9-8649-331b690b12f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:53.363084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98667aea-d2eb-47a9-8649-331b690b12f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:53.363518 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-98667aea-d2eb-47a9-8649-331b690b12f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:53.423766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-98667aea-d2eb-47a9-8649-331b690b12f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:53.431582 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-98667aea-d2eb-47a9-8649-331b690b12f4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081240 Jul 27 20:43:53.432256 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1150/2157] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:53 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:54.451614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2f211276-785d-4a93-9243-6b3779c6283c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:54.452234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2f211276-785d-4a93-9243-6b3779c6283c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:54.458767 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f211276-785d-4a93-9243-6b3779c6283c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:54.459244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f211276-785d-4a93-9243-6b3779c6283c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:54.460001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f211276-785d-4a93-9243-6b3779c6283c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:54.460469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f211276-785d-4a93-9243-6b3779c6283c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:54.520430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2f211276-785d-4a93-9243-6b3779c6283c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:54.528207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2f211276-785d-4a93-9243-6b3779c6283c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080537 Jul 27 20:43:54.528926 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1008/2158] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:54 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:55.549069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b1571896-7e75-48d9-907b-b54cc8cebe68 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:55.549681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b1571896-7e75-48d9-907b-b54cc8cebe68 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:55.555812 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1571896-7e75-48d9-907b-b54cc8cebe68 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:55.556264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1571896-7e75-48d9-907b-b54cc8cebe68 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:55.557064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1571896-7e75-48d9-907b-b54cc8cebe68 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:55.557997 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1571896-7e75-48d9-907b-b54cc8cebe68 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:55.619747 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b1571896-7e75-48d9-907b-b54cc8cebe68 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:55.628457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b1571896-7e75-48d9-907b-b54cc8cebe68 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083389 Jul 27 20:43:55.629038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1151/2159] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:55 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:56.650692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c1a2a93c-f135-4b1d-88a3-dc55c0aad237 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:56.651881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c1a2a93c-f135-4b1d-88a3-dc55c0aad237 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:56.658489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1a2a93c-f135-4b1d-88a3-dc55c0aad237 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:56.658935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1a2a93c-f135-4b1d-88a3-dc55c0aad237 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:56.659685 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1a2a93c-f135-4b1d-88a3-dc55c0aad237 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:56.660116 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1a2a93c-f135-4b1d-88a3-dc55c0aad237 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:56.720176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c1a2a93c-f135-4b1d-88a3-dc55c0aad237 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:56.727800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c1a2a93c-f135-4b1d-88a3-dc55c0aad237 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081006 Jul 27 20:43:56.728370 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1009/2160] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:56 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:57.748697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-946a6c7f-8d3c-4001-a433-e67363d2eba2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:57.749312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-946a6c7f-8d3c-4001-a433-e67363d2eba2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:57.755796 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-946a6c7f-8d3c-4001-a433-e67363d2eba2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:57.756248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-946a6c7f-8d3c-4001-a433-e67363d2eba2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:57.757039 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-946a6c7f-8d3c-4001-a433-e67363d2eba2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:57.757475 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-946a6c7f-8d3c-4001-a433-e67363d2eba2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:57.819265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-946a6c7f-8d3c-4001-a433-e67363d2eba2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:57.827479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-946a6c7f-8d3c-4001-a433-e67363d2eba2 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082685 Jul 27 20:43:57.828055 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1152/2161] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:57 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:58.848454 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d260ca29-2e60-4dfb-8886-a9deae377107 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:58.849103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d260ca29-2e60-4dfb-8886-a9deae377107 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:58.855996 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d260ca29-2e60-4dfb-8886-a9deae377107 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:58.856475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d260ca29-2e60-4dfb-8886-a9deae377107 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:58.857238 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d260ca29-2e60-4dfb-8886-a9deae377107 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:58.857677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d260ca29-2e60-4dfb-8886-a9deae377107 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:58.922453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d260ca29-2e60-4dfb-8886-a9deae377107 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:58.930378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d260ca29-2e60-4dfb-8886-a9deae377107 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085789 Jul 27 20:43:58.930948 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1010/2162] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:58 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:59.952238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7444b803-1381-4731-8c00-24467e5f7406 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:59.952878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7444b803-1381-4731-8c00-24467e5f7406 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:59.959315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7444b803-1381-4731-8c00-24467e5f7406 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:59.959764 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7444b803-1381-4731-8c00-24467e5f7406 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:59.960554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7444b803-1381-4731-8c00-24467e5f7406 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:59.960990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7444b803-1381-4731-8c00-24467e5f7406 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:00.025374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7444b803-1381-4731-8c00-24467e5f7406 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:00.033289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7444b803-1381-4731-8c00-24467e5f7406 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.085552 Jul 27 20:44:00.033872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1153/2163] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:59 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:01.054397 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-caca3914-e88b-46db-9056-c04f2805c203 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:01.055045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-caca3914-e88b-46db-9056-c04f2805c203 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:01.062311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caca3914-e88b-46db-9056-c04f2805c203 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:01.062768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caca3914-e88b-46db-9056-c04f2805c203 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:01.063524 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caca3914-e88b-46db-9056-c04f2805c203 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:01.063961 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-caca3914-e88b-46db-9056-c04f2805c203 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:01.125135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-caca3914-e88b-46db-9056-c04f2805c203 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:01.132942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-caca3914-e88b-46db-9056-c04f2805c203 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082519 Jul 27 20:44:01.133522 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1011/2164] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:01 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:02.154815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-22fa65f2-4d40-4ab0-b72e-984a7a34f2a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:02.155426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-22fa65f2-4d40-4ab0-b72e-984a7a34f2a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:02.161947 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22fa65f2-4d40-4ab0-b72e-984a7a34f2a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:02.162389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22fa65f2-4d40-4ab0-b72e-984a7a34f2a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:02.163139 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22fa65f2-4d40-4ab0-b72e-984a7a34f2a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:02.163569 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22fa65f2-4d40-4ab0-b72e-984a7a34f2a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:02.223601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-22fa65f2-4d40-4ab0-b72e-984a7a34f2a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:02.232123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-22fa65f2-4d40-4ab0-b72e-984a7a34f2a5 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081718 Jul 27 20:44:02.232750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1154/2165] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:02 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:03.252911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ee21ede9-6ac0-433a-9e14-c95365bcf23f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:03.253531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ee21ede9-6ac0-433a-9e14-c95365bcf23f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:03.259989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee21ede9-6ac0-433a-9e14-c95365bcf23f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:03.260469 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee21ede9-6ac0-433a-9e14-c95365bcf23f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:03.261229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee21ede9-6ac0-433a-9e14-c95365bcf23f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:03.261667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee21ede9-6ac0-433a-9e14-c95365bcf23f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:03.324280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ee21ede9-6ac0-433a-9e14-c95365bcf23f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:03.332325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ee21ede9-6ac0-433a-9e14-c95365bcf23f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083251 Jul 27 20:44:03.332923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1012/2166] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:03 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:04.353407 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d16f7938-555b-4788-a785-d4458d03af94 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:04.354581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d16f7938-555b-4788-a785-d4458d03af94 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:04.361147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d16f7938-555b-4788-a785-d4458d03af94 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:04.361597 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d16f7938-555b-4788-a785-d4458d03af94 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:04.362377 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d16f7938-555b-4788-a785-d4458d03af94 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:04.362810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d16f7938-555b-4788-a785-d4458d03af94 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:04.428953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d16f7938-555b-4788-a785-d4458d03af94 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:04.437382 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d16f7938-555b-4788-a785-d4458d03af94 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.087868 Jul 27 20:44:04.437952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1155/2167] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:04 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:05.458525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-358a34f7-18c7-48cf-bc76-97a5944d3a14 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:05.459141 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-358a34f7-18c7-48cf-bc76-97a5944d3a14 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:05.465933 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-358a34f7-18c7-48cf-bc76-97a5944d3a14 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:05.466383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-358a34f7-18c7-48cf-bc76-97a5944d3a14 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:05.467176 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-358a34f7-18c7-48cf-bc76-97a5944d3a14 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:05.467615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-358a34f7-18c7-48cf-bc76-97a5944d3a14 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:05.678284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-358a34f7-18c7-48cf-bc76-97a5944d3a14 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:05.686760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-358a34f7-18c7-48cf-bc76-97a5944d3a14 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.232202 Jul 27 20:44:05.687343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1013/2168] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:05 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:06.707121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c4a1ae10-f0b7-4fe2-a856-9a6817f01932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:06.707730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c4a1ae10-f0b7-4fe2-a856-9a6817f01932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:06.714990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4a1ae10-f0b7-4fe2-a856-9a6817f01932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:06.715442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4a1ae10-f0b7-4fe2-a856-9a6817f01932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:06.716189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4a1ae10-f0b7-4fe2-a856-9a6817f01932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:06.716651 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4a1ae10-f0b7-4fe2-a856-9a6817f01932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:06.776127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c4a1ae10-f0b7-4fe2-a856-9a6817f01932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:06.783818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c4a1ae10-f0b7-4fe2-a856-9a6817f01932 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080586 Jul 27 20:44:06.784429 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1156/2169] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:06 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:07.805324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e2fdc680-7aac-4c42-9c4c-d130be84bf7e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:07.805973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e2fdc680-7aac-4c42-9c4c-d130be84bf7e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:07.813195 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2fdc680-7aac-4c42-9c4c-d130be84bf7e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:07.813648 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2fdc680-7aac-4c42-9c4c-d130be84bf7e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:07.814409 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2fdc680-7aac-4c42-9c4c-d130be84bf7e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:07.814847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e2fdc680-7aac-4c42-9c4c-d130be84bf7e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:07.874899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e2fdc680-7aac-4c42-9c4c-d130be84bf7e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:07.882740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e2fdc680-7aac-4c42-9c4c-d130be84bf7e tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081277 Jul 27 20:44:07.883300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1014/2170] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:07 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:08.903139 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-21558e13-5a6c-4d05-b039-e13fa774b884 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:08.903692 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-21558e13-5a6c-4d05-b039-e13fa774b884 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:08.910148 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21558e13-5a6c-4d05-b039-e13fa774b884 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:08.910594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21558e13-5a6c-4d05-b039-e13fa774b884 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:08.911344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21558e13-5a6c-4d05-b039-e13fa774b884 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:08.911779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21558e13-5a6c-4d05-b039-e13fa774b884 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:08.974583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-21558e13-5a6c-4d05-b039-e13fa774b884 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:08.982580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-21558e13-5a6c-4d05-b039-e13fa774b884 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083353 Jul 27 20:44:08.983163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1157/2171] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:08 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:10.003050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e90acfdc-b169-441f-8cc8-75903b03c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:10.003644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e90acfdc-b169-441f-8cc8-75903b03c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:10.010635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e90acfdc-b169-441f-8cc8-75903b03c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:10.015403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e90acfdc-b169-441f-8cc8-75903b03c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:10.015403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e90acfdc-b169-441f-8cc8-75903b03c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:10.015403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e90acfdc-b169-441f-8cc8-75903b03c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:10.016098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=84 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:10.071799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e90acfdc-b169-441f-8cc8-75903b03c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:10.080038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e90acfdc-b169-441f-8cc8-75903b03c207 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080846 Jul 27 20:44:10.080825 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1015/2172] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:09 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:11.101434 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3ab35f7e-0cbc-41de-bcae-14dd68764530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:11.102047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3ab35f7e-0cbc-41de-bcae-14dd68764530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:11.109060 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ab35f7e-0cbc-41de-bcae-14dd68764530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:11.109510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ab35f7e-0cbc-41de-bcae-14dd68764530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:11.110260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ab35f7e-0cbc-41de-bcae-14dd68764530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:11.110694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ab35f7e-0cbc-41de-bcae-14dd68764530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:11.171261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3ab35f7e-0cbc-41de-bcae-14dd68764530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:11.179064 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3ab35f7e-0cbc-41de-bcae-14dd68764530 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081484 Jul 27 20:44:11.179629 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1158/2173] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:11 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:44:12.200117 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e3270783-6541-4b96-87a6-59fda4ce5b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:12.200777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e3270783-6541-4b96-87a6-59fda4ce5b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:12.203086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=28 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:12.207802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3270783-6541-4b96-87a6-59fda4ce5b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:12.208248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3270783-6541-4b96-87a6-59fda4ce5b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:12.209045 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3270783-6541-4b96-87a6-59fda4ce5b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:12.209480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3270783-6541-4b96-87a6-59fda4ce5b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:12.270395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e3270783-6541-4b96-87a6-59fda4ce5b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:12.278420 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e3270783-6541-4b96-87a6-59fda4ce5b21 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082704 Jul 27 20:44:12.278984 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1016/2174] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:12 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:13.299386 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9fe92497-23b9-4df3-9735-c229d5defa42 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:13.299995 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9fe92497-23b9-4df3-9735-c229d5defa42 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:13.307231 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9fe92497-23b9-4df3-9735-c229d5defa42 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:13.307687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9fe92497-23b9-4df3-9735-c229d5defa42 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:13.308470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9fe92497-23b9-4df3-9735-c229d5defa42 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:13.308907 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9fe92497-23b9-4df3-9735-c229d5defa42 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:13.312831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=84 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:13.372610 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9fe92497-23b9-4df3-9735-c229d5defa42 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:13.380496 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9fe92497-23b9-4df3-9735-c229d5defa42 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084960 Jul 27 20:44:13.381062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1159/2175] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:13 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:14.401620 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8cb4638d-716e-4e5b-9af2-bf44059d742d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:14.402236 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8cb4638d-716e-4e5b-9af2-bf44059d742d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:14.408575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8cb4638d-716e-4e5b-9af2-bf44059d742d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:14.409027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8cb4638d-716e-4e5b-9af2-bf44059d742d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:14.409785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8cb4638d-716e-4e5b-9af2-bf44059d742d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:14.410221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8cb4638d-716e-4e5b-9af2-bf44059d742d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:14.470889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8cb4638d-716e-4e5b-9af2-bf44059d742d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:14.479174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8cb4638d-716e-4e5b-9af2-bf44059d742d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.081381 Jul 27 20:44:14.479760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1017/2176] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:14 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:15.499934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-039110c0-04ca-4d9b-b82f-d139f673334b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:15.500577 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-039110c0-04ca-4d9b-b82f-d139f673334b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:15.507120 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-039110c0-04ca-4d9b-b82f-d139f673334b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:15.507562 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-039110c0-04ca-4d9b-b82f-d139f673334b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:15.508309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-039110c0-04ca-4d9b-b82f-d139f673334b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:15.508772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-039110c0-04ca-4d9b-b82f-d139f673334b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:15.568400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-039110c0-04ca-4d9b-b82f-d139f673334b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:15.576103 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-039110c0-04ca-4d9b-b82f-d139f673334b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080060 Jul 27 20:44:15.576715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1160/2177] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:15 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:16.596593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8fb14a0e-38c2-42f0-b1bc-b01e55427c50 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:16.597099 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8fb14a0e-38c2-42f0-b1bc-b01e55427c50 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:16.603532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fb14a0e-38c2-42f0-b1bc-b01e55427c50 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:16.604013 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fb14a0e-38c2-42f0-b1bc-b01e55427c50 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:16.604787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fb14a0e-38c2-42f0-b1bc-b01e55427c50 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:16.605214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8fb14a0e-38c2-42f0-b1bc-b01e55427c50 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:16.665324 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8fb14a0e-38c2-42f0-b1bc-b01e55427c50 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:16.673295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8fb14a0e-38c2-42f0-b1bc-b01e55427c50 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.080679 Jul 27 20:44:16.673868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1018/2178] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:16 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:17.694245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-554feb99-2a5b-4841-b12e-51a404a6b387 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:17.694845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-554feb99-2a5b-4841-b12e-51a404a6b387 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:17.697644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=28 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:17.702358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-554feb99-2a5b-4841-b12e-51a404a6b387 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:17.702844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-554feb99-2a5b-4841-b12e-51a404a6b387 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:17.703614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-554feb99-2a5b-4841-b12e-51a404a6b387 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:17.704043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-554feb99-2a5b-4841-b12e-51a404a6b387 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:17.767263 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-554feb99-2a5b-4841-b12e-51a404a6b387 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:17.774996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-554feb99-2a5b-4841-b12e-51a404a6b387 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.084597 Jul 27 20:44:17.776276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1161/2179] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:17 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:18.797708 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9ea3ec5f-e96a-42c3-aa11-9cd7f3f9ede0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:18.798359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9ea3ec5f-e96a-42c3-aa11-9cd7f3f9ede0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:18.804983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ea3ec5f-e96a-42c3-aa11-9cd7f3f9ede0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:18.805435 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ea3ec5f-e96a-42c3-aa11-9cd7f3f9ede0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:18.806204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ea3ec5f-e96a-42c3-aa11-9cd7f3f9ede0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:18.806641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9ea3ec5f-e96a-42c3-aa11-9cd7f3f9ede0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:18.868845 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9ea3ec5f-e96a-42c3-aa11-9cd7f3f9ede0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:18.876782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9ea3ec5f-e96a-42c3-aa11-9cd7f3f9ede0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082993 Jul 27 20:44:18.877284 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1019/2180] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:18 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:19.897092 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-191d4fe4-cade-4399-ac3b-dc0e4dc2e395 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:19.897733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-191d4fe4-cade-4399-ac3b-dc0e4dc2e395 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:19.904601 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-191d4fe4-cade-4399-ac3b-dc0e4dc2e395 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:19.905080 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-191d4fe4-cade-4399-ac3b-dc0e4dc2e395 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:19.905873 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-191d4fe4-cade-4399-ac3b-dc0e4dc2e395 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:19.906330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-191d4fe4-cade-4399-ac3b-dc0e4dc2e395 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:19.968319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-191d4fe4-cade-4399-ac3b-dc0e4dc2e395 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:19.976221 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-191d4fe4-cade-4399-ac3b-dc0e4dc2e395 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.083004 Jul 27 20:44:19.976832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1162/2181] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:19 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:20.997902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d704d4fc-e892-4019-860b-4fec763012d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:20.998521 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d704d4fc-e892-4019-860b-4fec763012d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:21.005160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d704d4fc-e892-4019-860b-4fec763012d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:21.005613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d704d4fc-e892-4019-860b-4fec763012d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:21.010692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d704d4fc-e892-4019-860b-4fec763012d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:21.010692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d704d4fc-e892-4019-860b-4fec763012d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:21.067321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d704d4fc-e892-4019-860b-4fec763012d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:21.075898 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d704d4fc-e892-4019-860b-4fec763012d4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.082452 Jul 27 20:44:21.076485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1020/2182] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:20 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:22.096133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a7c844a4-b11c-4a13-8bde-787c20434914 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:22.096772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a7c844a4-b11c-4a13-8bde-787c20434914 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:22.103180 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7c844a4-b11c-4a13-8bde-787c20434914 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:22.103635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7c844a4-b11c-4a13-8bde-787c20434914 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:22.104406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7c844a4-b11c-4a13-8bde-787c20434914 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:22.104897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a7c844a4-b11c-4a13-8bde-787c20434914 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:22.173273 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a7c844a4-b11c-4a13-8bde-787c20434914 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:22.181356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a7c844a4-b11c-4a13-8bde-787c20434914 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 200 len: 1367 microversion: 2.1 time: 0.088955 Jul 27 20:44:22.181983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1163/2183] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:22 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:22.202648 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a0270991-862c-4fc9-8976-ecccc9926dbf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '.version_select at 0x7f35cebea820>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:22.291918 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a0270991-862c-4fc9-8976-ecccc9926dbf tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811947671" status: 202 len: 0 microversion: 2.1 time: 0.093071 Jul 27 20:44:22.292522 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1021/2184] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Jul 27 20:44:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811947671 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:44:23.092189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a87bdd03-7977-4f95-95ea-5db4ec93ba2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Action: 'create', calling method: .version_select at 0x7f35ca300160>, body: {"keypair": {"name": "tempest-keypair-156220661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYutV3xqVwocf8IuyJJr+SPdf4C0kTn2CAHSLoo8EvfjWK66wpKB7GORl0j1tWQ2UZkCHQVs1SZ8L9BgowChAlVSgc/imjVdIKY84865qpd9ebT4tafPjde437pi0btUg=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:44:23.108524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-a87bdd03-7977-4f95-95ea-5db4ec93ba2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Getting quotas for project a56bf911ebbf4dd1ac5ed4bb07a9f7b3. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:44:23.112197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-a87bdd03-7977-4f95-95ea-5db4ec93ba2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Getting quotas for user 6cc262a3c3314be8a6ee620ebfa6fe85 and project a56bf911ebbf4dd1ac5ed4bb07a9f7b3. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:44:23.241019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a87bdd03-7977-4f95-95ea-5db4ec93ba2f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152652 Jul 27 20:44:23.241633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1164/2185] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:44:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:44:25.499379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1763894254", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddbd5946-27bf-4cbf-b681-8257de653bc1"}], "security_groups": [{"name": "tempest-securitygroup--589168629"}], "key_name": "tempest-keypair-156220661", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:44:25.600625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] validate_networks() for [('ddbd5946-27bf-4cbf-b681-8257de653bc1', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:44:26.010553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:44:26.010981 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:44:26.011453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:44:26.011862 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:44:26.012272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:44:26.024198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:26.024198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:26.024198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:26.024198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:26.040172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Getting quotas for project a56bf911ebbf4dd1ac5ed4bb07a9f7b3. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:44:26.044787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Getting quotas for user 6cc262a3c3314be8a6ee620ebfa6fe85 and project a56bf911ebbf4dd1ac5ed4bb07a9f7b3. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:44:26.055593 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:44:26.058536 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:44:26.189144 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a07fc042-90bc-45bc-bb1c-feed4c78983a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694569 Jul 27 20:44:26.189801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1022/2186] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:44:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:44:26.201107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-13c873c5-7332-4e82-bfe7-96d99d46731f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:26.201720 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-13c873c5-7332-4e82-bfe7-96d99d46731f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:26.257910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-13c873c5-7332-4e82-bfe7-96d99d46731f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:26.264360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-13c873c5-7332-4e82-bfe7-96d99d46731f tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1237 microversion: 2.1 time: 0.067711 Jul 27 20:44:26.264980 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1165/2187] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:26 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:27.285955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f910cf3c-e919-41db-b13a-c6b2d2de6118 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:27.286527 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f910cf3c-e919-41db-b13a-c6b2d2de6118 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:27.293624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f910cf3c-e919-41db-b13a-c6b2d2de6118 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:27.294468 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f910cf3c-e919-41db-b13a-c6b2d2de6118 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:27.295278 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f910cf3c-e919-41db-b13a-c6b2d2de6118 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:27.295730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f910cf3c-e919-41db-b13a-c6b2d2de6118 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:27.358462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f910cf3c-e919-41db-b13a-c6b2d2de6118 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:27.368266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f910cf3c-e919-41db-b13a-c6b2d2de6118 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1241 microversion: 2.1 time: 0.085532 Jul 27 20:44:27.368266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1023/2188] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:27 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:28.389353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2a9b098b-8ea7-40ce-8bff-80391aaf879b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:28.390604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2a9b098b-8ea7-40ce-8bff-80391aaf879b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:28.397249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a9b098b-8ea7-40ce-8bff-80391aaf879b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:28.397699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a9b098b-8ea7-40ce-8bff-80391aaf879b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:28.398457 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a9b098b-8ea7-40ce-8bff-80391aaf879b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:28.399073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2a9b098b-8ea7-40ce-8bff-80391aaf879b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:28.468403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2a9b098b-8ea7-40ce-8bff-80391aaf879b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:28.475749 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2a9b098b-8ea7-40ce-8bff-80391aaf879b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1307 microversion: 2.1 time: 0.090420 Jul 27 20:44:28.476327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1166/2189] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:28 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:44:29.504483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-15e9872b-035b-44be-b2f5-dfc80093c25a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:29.505093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-15e9872b-035b-44be-b2f5-dfc80093c25a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:29.512003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-15e9872b-035b-44be-b2f5-dfc80093c25a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:29.512475 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-15e9872b-035b-44be-b2f5-dfc80093c25a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:29.513225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-15e9872b-035b-44be-b2f5-dfc80093c25a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:29.513653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-15e9872b-035b-44be-b2f5-dfc80093c25a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:29.728601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-15e9872b-035b-44be-b2f5-dfc80093c25a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:29.736571 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-15e9872b-035b-44be-b2f5-dfc80093c25a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1362 microversion: 2.1 time: 0.235923 Jul 27 20:44:29.737154 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1024/2190] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:29 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:29.959306 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-75f5a992-e53f-402e-b555-0ec86ccf5f6a req-bff653e3-dc0c-44a5-8139-e340f9865ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2948a9e0-218e-47c3-ae3b-731456e37b11", "tag": "120b2354-a6ab-4c01-bbdf-d0ff0d801962"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:44:29.969267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-75f5a992-e53f-402e-b555-0ec86ccf5f6a req-bff653e3-dc0c-44a5-8139-e340f9865ade service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:29.972971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-75f5a992-e53f-402e-b555-0ec86ccf5f6a req-bff653e3-dc0c-44a5-8139-e340f9865ade service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:29.980792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-75f5a992-e53f-402e-b555-0ec86ccf5f6a req-bff653e3-dc0c-44a5-8139-e340f9865ade service nova] Creating event network-changed:120b2354-a6ab-4c01-bbdf-d0ff0d801962 for instance 2948a9e0-218e-47c3-ae3b-731456e37b11 on hv-cinder-85124 Jul 27 20:44:29.986094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-75f5a992-e53f-402e-b555-0ec86ccf5f6a req-bff653e3-dc0c-44a5-8139-e340f9865ade service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087591 Jul 27 20:44:29.986717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1167/2191] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:44:30.759484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1b1b8507-2427-49d9-a316-cae4b29a018a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:30.760132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1b1b8507-2427-49d9-a316-cae4b29a018a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:30.766605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b1b8507-2427-49d9-a316-cae4b29a018a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:30.767057 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b1b8507-2427-49d9-a316-cae4b29a018a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:30.767818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b1b8507-2427-49d9-a316-cae4b29a018a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:30.768254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b1b8507-2427-49d9-a316-cae4b29a018a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:30.895756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1b1b8507-2427-49d9-a316-cae4b29a018a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:30.903082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1b1b8507-2427-49d9-a316-cae4b29a018a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1362 microversion: 2.1 time: 0.148095 Jul 27 20:44:30.903646 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1025/2192] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:30 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:44:31.924152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5ccb46d6-4301-446e-9f8a-5a6f80941120 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:31.924809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5ccb46d6-4301-446e-9f8a-5a6f80941120 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:31.931592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ccb46d6-4301-446e-9f8a-5a6f80941120 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:31.932041 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ccb46d6-4301-446e-9f8a-5a6f80941120 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:31.932830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ccb46d6-4301-446e-9f8a-5a6f80941120 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:31.933260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ccb46d6-4301-446e-9f8a-5a6f80941120 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:32.063609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5ccb46d6-4301-446e-9f8a-5a6f80941120 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:32.071255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5ccb46d6-4301-446e-9f8a-5a6f80941120 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1362 microversion: 2.1 time: 0.151710 Jul 27 20:44:32.071833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1168/2193] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:31 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:33.091710 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-270632d8-503f-4faf-b2c8-b9aaae5f99e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:33.092355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-270632d8-503f-4faf-b2c8-b9aaae5f99e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:33.098842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-270632d8-503f-4faf-b2c8-b9aaae5f99e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:33.099296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-270632d8-503f-4faf-b2c8-b9aaae5f99e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:33.100052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-270632d8-503f-4faf-b2c8-b9aaae5f99e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:33.100520 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-270632d8-503f-4faf-b2c8-b9aaae5f99e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:33.232940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-270632d8-503f-4faf-b2c8-b9aaae5f99e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:33.240263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-270632d8-503f-4faf-b2c8-b9aaae5f99e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1362 microversion: 2.1 time: 0.153079 Jul 27 20:44:33.240858 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1026/2194] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:33 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:34.261193 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e6f73461-dda4-4fb3-b482-6fa5489a18c1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:34.261797 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e6f73461-dda4-4fb3-b482-6fa5489a18c1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:34.268275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6f73461-dda4-4fb3-b482-6fa5489a18c1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:34.268757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6f73461-dda4-4fb3-b482-6fa5489a18c1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:34.269506 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6f73461-dda4-4fb3-b482-6fa5489a18c1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:34.269933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e6f73461-dda4-4fb3-b482-6fa5489a18c1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:34.400748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e6f73461-dda4-4fb3-b482-6fa5489a18c1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:34.408006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e6f73461-dda4-4fb3-b482-6fa5489a18c1 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1362 microversion: 2.1 time: 0.151208 Jul 27 20:44:34.408606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1169/2195] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:34 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:35.428302 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-87500a3d-af98-4c8c-bf16-fce3c1fd62b3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:35.428938 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-87500a3d-af98-4c8c-bf16-fce3c1fd62b3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:35.435392 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87500a3d-af98-4c8c-bf16-fce3c1fd62b3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:35.435837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87500a3d-af98-4c8c-bf16-fce3c1fd62b3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:35.436719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87500a3d-af98-4c8c-bf16-fce3c1fd62b3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:35.437152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87500a3d-af98-4c8c-bf16-fce3c1fd62b3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:35.567540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-87500a3d-af98-4c8c-bf16-fce3c1fd62b3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:35.575383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-87500a3d-af98-4c8c-bf16-fce3c1fd62b3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1362 microversion: 2.1 time: 0.150931 Jul 27 20:44:35.575951 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1027/2196] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:35 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:35.857575 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-47f8baa2-22ce-401d-9a4d-9463340ede0f req-ea8870df-22d7-4d5c-a3b5-2f4ce6cadf1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2948a9e0-218e-47c3-ae3b-731456e37b11", "name": "network-vif-plugged", "status": "completed", "tag": "120b2354-a6ab-4c01-bbdf-d0ff0d801962"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:44:35.868869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-47f8baa2-22ce-401d-9a4d-9463340ede0f req-ea8870df-22d7-4d5c-a3b5-2f4ce6cadf1b service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:35.869309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-47f8baa2-22ce-401d-9a4d-9463340ede0f req-ea8870df-22d7-4d5c-a3b5-2f4ce6cadf1b service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:35.879914 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-47f8baa2-22ce-401d-9a4d-9463340ede0f req-ea8870df-22d7-4d5c-a3b5-2f4ce6cadf1b service nova] Creating event network-vif-plugged:120b2354-a6ab-4c01-bbdf-d0ff0d801962 for instance 2948a9e0-218e-47c3-ae3b-731456e37b11 on hv-cinder-85124 Jul 27 20:44:35.884935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-47f8baa2-22ce-401d-9a4d-9463340ede0f req-ea8870df-22d7-4d5c-a3b5-2f4ce6cadf1b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030981 Jul 27 20:44:35.885447 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1170/2197] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:44:36.596639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f0236c9c-69fa-4603-b6a2-2aa8c3de8b4c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:36.597246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f0236c9c-69fa-4603-b6a2-2aa8c3de8b4c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:36.599079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:36.599756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:36.605650 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0236c9c-69fa-4603-b6a2-2aa8c3de8b4c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:36.606154 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0236c9c-69fa-4603-b6a2-2aa8c3de8b4c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:36.607007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0236c9c-69fa-4603-b6a2-2aa8c3de8b4c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:36.607455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0236c9c-69fa-4603-b6a2-2aa8c3de8b4c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:36.735383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f0236c9c-69fa-4603-b6a2-2aa8c3de8b4c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:36.742991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f0236c9c-69fa-4603-b6a2-2aa8c3de8b4c tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1362 microversion: 2.1 time: 0.149972 Jul 27 20:44:36.743552 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1028/2198] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:36 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:37.760320 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:37.764885 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8575af93-a2f4-419a-b4e2-d55fc7c74d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:37.765631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8575af93-a2f4-419a-b4e2-d55fc7c74d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:37.777424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8575af93-a2f4-419a-b4e2-d55fc7c74d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:37.777424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8575af93-a2f4-419a-b4e2-d55fc7c74d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:37.777424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8575af93-a2f4-419a-b4e2-d55fc7c74d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:37.777424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8575af93-a2f4-419a-b4e2-d55fc7c74d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:37.905019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8575af93-a2f4-419a-b4e2-d55fc7c74d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:37.912425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8575af93-a2f4-419a-b4e2-d55fc7c74d69 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1362 microversion: 2.1 time: 0.153108 Jul 27 20:44:37.912990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1171/2199] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:37 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:38.933965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dc9cf327-a97e-42aa-bc13-55787a864722 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:38.934517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dc9cf327-a97e-42aa-bc13-55787a864722 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:38.940927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc9cf327-a97e-42aa-bc13-55787a864722 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:38.941376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc9cf327-a97e-42aa-bc13-55787a864722 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:38.942131 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc9cf327-a97e-42aa-bc13-55787a864722 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:38.942560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc9cf327-a97e-42aa-bc13-55787a864722 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:39.069969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dc9cf327-a97e-42aa-bc13-55787a864722 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:39.078015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dc9cf327-a97e-42aa-bc13-55787a864722 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1548 microversion: 2.1 time: 0.148507 Jul 27 20:44:39.078582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1029/2200] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:38 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:39.097777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-15fe98d8-a44d-4e13-b690-8deff65550db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:39.098296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-15fe98d8-a44d-4e13-b690-8deff65550db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:39.105042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15fe98d8-a44d-4e13-b690-8deff65550db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:39.105483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15fe98d8-a44d-4e13-b690-8deff65550db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:39.106224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15fe98d8-a44d-4e13-b690-8deff65550db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:39.106650 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-15fe98d8-a44d-4e13-b690-8deff65550db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:39.181602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-15fe98d8-a44d-4e13-b690-8deff65550db tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087629 Jul 27 20:44:39.182197 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1172/2201] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 20:44:39 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:44:40.449833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-aa4127fd-8d17-4ac9-b0b0-e6d6071200b7 req-6d7531b9-e9f8-4e83-ad22-8180c5c320a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2948a9e0-218e-47c3-ae3b-731456e37b11", "tag": "120b2354-a6ab-4c01-bbdf-d0ff0d801962"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:44:40.459768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-aa4127fd-8d17-4ac9-b0b0-e6d6071200b7 req-6d7531b9-e9f8-4e83-ad22-8180c5c320a5 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:40.460210 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-aa4127fd-8d17-4ac9-b0b0-e6d6071200b7 req-6d7531b9-e9f8-4e83-ad22-8180c5c320a5 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:40.465956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=80 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:40.473403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-aa4127fd-8d17-4ac9-b0b0-e6d6071200b7 req-6d7531b9-e9f8-4e83-ad22-8180c5c320a5 service nova] Creating event network-changed:120b2354-a6ab-4c01-bbdf-d0ff0d801962 for instance 2948a9e0-218e-47c3-ae3b-731456e37b11 on hv-cinder-85124 Jul 27 20:44:40.479152 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-aa4127fd-8d17-4ac9-b0b0-e6d6071200b7 req-6d7531b9-e9f8-4e83-ad22-8180c5c320a5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033434 Jul 27 20:44:40.479776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1030/2202] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:44:43.429842 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3f6b9673-d016-4944-93d3-4c180ff3e808 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:43.430854 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3f6b9673-d016-4944-93d3-4c180ff3e808 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:43.436888 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f6b9673-d016-4944-93d3-4c180ff3e808 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:43.437366 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f6b9673-d016-4944-93d3-4c180ff3e808 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:43.438117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f6b9673-d016-4944-93d3-4c180ff3e808 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:43.438547 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3f6b9673-d016-4944-93d3-4c180ff3e808 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:43.442416 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=62 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:43.463862 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3f6b9673-d016-4944-93d3-4c180ff3e808 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:44:43.701772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3f6b9673-d016-4944-93d3-4c180ff3e808 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "DELETE /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 204 len: 0 microversion: 2.1 time: 0.275903 Jul 27 20:44:43.702327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1173/2203] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:44:43 2022] DELETE /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:44:43.711378 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b88b62ad-6a95-4ad3-9e46-539b85d73673 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:43.712076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b88b62ad-6a95-4ad3-9e46-539b85d73673 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:43.714316 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:43.719273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b88b62ad-6a95-4ad3-9e46-539b85d73673 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:43.719748 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b88b62ad-6a95-4ad3-9e46-539b85d73673 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:43.720544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b88b62ad-6a95-4ad3-9e46-539b85d73673 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:43.720982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b88b62ad-6a95-4ad3-9e46-539b85d73673 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:43.850400 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b88b62ad-6a95-4ad3-9e46-539b85d73673 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:43.858433 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b88b62ad-6a95-4ad3-9e46-539b85d73673 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1508 microversion: 2.1 time: 0.151799 Jul 27 20:44:43.858988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1031/2204] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:43 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:44.879786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-264b1b8c-56e6-44ec-9b12-679efb04f63e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:44.881372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-264b1b8c-56e6-44ec-9b12-679efb04f63e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:44.887693 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-264b1b8c-56e6-44ec-9b12-679efb04f63e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:44.888189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-264b1b8c-56e6-44ec-9b12-679efb04f63e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:44.888918 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-264b1b8c-56e6-44ec-9b12-679efb04f63e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:44.889345 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-264b1b8c-56e6-44ec-9b12-679efb04f63e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:44.983338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-264b1b8c-56e6-44ec-9b12-679efb04f63e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:44.983543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-72d105ca-bf13-4f14-b92b-3e7468131e7b req-b0831ffd-9167-4346-9f69-718147d7c748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982bde5c-b64d-40ee-aedf-9553303e1aef", "name": "network-vif-deleted", "tag": "492006da-836b-47ce-9b46-8ab395f9c9b5"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:44:44.991368 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-264b1b8c-56e6-44ec-9b12-679efb04f63e tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 200 len: 1466 microversion: 2.1 time: 0.115758 Jul 27 20:44:44.991952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1174/2205] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:44 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 1466 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:44.994758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-72d105ca-bf13-4f14-b92b-3e7468131e7b req-b0831ffd-9167-4346-9f69-718147d7c748 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:44.995300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-72d105ca-bf13-4f14-b92b-3e7468131e7b req-b0831ffd-9167-4346-9f69-718147d7c748 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:45.006817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-72d105ca-bf13-4f14-b92b-3e7468131e7b req-b0831ffd-9167-4346-9f69-718147d7c748 service nova] Creating event network-vif-deleted:492006da-836b-47ce-9b46-8ab395f9c9b5 for instance 982bde5c-b64d-40ee-aedf-9553303e1aef on hv-cinder-85124 Jul 27 20:44:45.012632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-72d105ca-bf13-4f14-b92b-3e7468131e7b req-b0831ffd-9167-4346-9f69-718147d7c748 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 Jul 27 20:44:45.013684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1032/2206] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:44:46.014740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:46.015498 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 982bde5c-b64d-40ee-aedf-9553303e1aef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:46.022052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:46.022502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:46.023253 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:46.024267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:46.037561 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] HTTP exception thrown: Instance 982bde5c-b64d-40ee-aedf-9553303e1aef could not be found. Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Request method failure captured: Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef HTTP/1.1 Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxkHcqFutE3EAwyNg-wOR23lGSJw6Df-TrBVwl_YeaWrQCcuyV_o7y55BTu7wtbyzDU1nQcMDdYHjx8FaLCUtIH5NgZVblGVR9eBSLB-zJpYk3oEnk_fLrBVfz20mqQE3IX3kEw08ykZd38hUysPDdR_niol8cQ15JGsxxLtJXe5rM Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 2ff46475bc95496f93ad4ac4459d7cc5 Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029424536 Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:44:46.039165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ff46475bc95496f93ad4ac4459d7cc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ff46475bc95496f93ad4ac4459d7cc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2ff46475bc95496f93ad4ac4459d7cc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2ff46475bc95496f93ad4ac4459d7cc5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029424536 Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 2ff46475bc95496f93ad4ac4459d7cc5 Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029424536 Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-ServerRescueNegativeTestJSON-1029424536-project Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 77b0df6c83a84dbcb0fa5802c93dc6ae Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029424536-project Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 982bde5c-b64d-40ee-aedf-9553303e1aef could not be found. Jul 27 20:44:46.040908 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '982bde5c-b64d-40ee-aedf-9553303e1aef'} Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982bde5c-b64d-40ee-aedf-9553303e1aef could not be found. Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:44:46.041981 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982bde5c-b64d-40ee-aedf-9553303e1aef could not be found. Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982bde5c-b64d-40ee-aedf-9553303e1aef could not be found. Jul 27 20:44:46.043625 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:44:46.045246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Returning 404 to user: Instance 982bde5c-b64d-40ee-aedf-9553303e1aef could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:44:46.045246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-224a1387-3204-4c0a-bf50-70b3af939962 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef" status: 404 len: 111 microversion: 2.1 time: 0.030714 Jul 27 20:44:46.045246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1175/2207] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:46 2022] GET /compute/v2.1/servers/982bde5c-b64d-40ee-aedf-9553303e1aef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:44:46.050214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-adc76010-bac4-4871-9de0-9f67f281bb27 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:46.050802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-adc76010-bac4-4871-9de0-9f67f281bb27 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:46.057010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-adc76010-bac4-4871-9de0-9f67f281bb27 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:46.057463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-adc76010-bac4-4871-9de0-9f67f281bb27 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:46.058221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-adc76010-bac4-4871-9de0-9f67f281bb27 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:46.058663 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-adc76010-bac4-4871-9de0-9f67f281bb27 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:46.086014 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-adc76010-bac4-4871-9de0-9f67f281bb27 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:44:46.330194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-adc76010-bac4-4871-9de0-9f67f281bb27 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "DELETE /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 204 len: 0 microversion: 2.1 time: 0.284234 Jul 27 20:44:46.330718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1033/2208] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:44:46 2022] DELETE /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:44:46.343173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bcbf0c34-d17e-43b2-a70d-b9f825c40bfd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:46.343789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bcbf0c34-d17e-43b2-a70d-b9f825c40bfd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:46.349822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bcbf0c34-d17e-43b2-a70d-b9f825c40bfd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:46.350265 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bcbf0c34-d17e-43b2-a70d-b9f825c40bfd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:46.351018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bcbf0c34-d17e-43b2-a70d-b9f825c40bfd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:46.351444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bcbf0c34-d17e-43b2-a70d-b9f825c40bfd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:46.482952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bcbf0c34-d17e-43b2-a70d-b9f825c40bfd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:46.490426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bcbf0c34-d17e-43b2-a70d-b9f825c40bfd tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1521 microversion: 2.1 time: 0.155550 Jul 27 20:44:46.490987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1176/2209] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:46 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:47.408359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-d444de55-76b1-4b83-ab17-ecd55dc293fd req-cb6af14e-09a8-457c-9533-8c1f3e102475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4ea93-fe33-426a-aa16-4ecfa7521db5", "name": "network-vif-deleted", "tag": "5583e13a-a514-4349-b84b-69d2a82f1085"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:44:47.419717 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-d444de55-76b1-4b83-ab17-ecd55dc293fd req-cb6af14e-09a8-457c-9533-8c1f3e102475 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:47.420280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-d444de55-76b1-4b83-ab17-ecd55dc293fd req-cb6af14e-09a8-457c-9533-8c1f3e102475 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:47.431089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-d444de55-76b1-4b83-ab17-ecd55dc293fd req-cb6af14e-09a8-457c-9533-8c1f3e102475 service nova] Creating event network-vif-deleted:5583e13a-a514-4349-b84b-69d2a82f1085 for instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 on hv-cinder-85124 Jul 27 20:44:47.435807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-d444de55-76b1-4b83-ab17-ecd55dc293fd req-cb6af14e-09a8-457c-9533-8c1f3e102475 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031511 Jul 27 20:44:47.437472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1034/2210] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:44:47.512372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-129fbcdf-0238-4a05-afc7-8b8bce5da8b1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:47.513008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-129fbcdf-0238-4a05-afc7-8b8bce5da8b1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:47.519709 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-129fbcdf-0238-4a05-afc7-8b8bce5da8b1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:47.520157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-129fbcdf-0238-4a05-afc7-8b8bce5da8b1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:47.520960 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-129fbcdf-0238-4a05-afc7-8b8bce5da8b1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:47.521395 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-129fbcdf-0238-4a05-afc7-8b8bce5da8b1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:47.595025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-129fbcdf-0238-4a05-afc7-8b8bce5da8b1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0df6c83a84dbcb0fa5802c93dc6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff46475bc95496f93ad4ac4459d7cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:44:47.602620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-129fbcdf-0238-4a05-afc7-8b8bce5da8b1 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 200 len: 1307 microversion: 2.1 time: 0.094638 Jul 27 20:44:47.603189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1177/2211] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:47 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:44:48.625085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:48.625713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] [instance: 77d4ea93-fe33-426a-aa16-4ecfa7521db5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:48.631983 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:48.632456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:48.633280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:48.633735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:48.646625 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] HTTP exception thrown: Instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 could not be found. Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Request method failure captured: Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 HTTP/1.1 Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxkHcqFutE3EAwyNg-wOR23lGSJw6Df-TrBVwl_YeaWrQCcuyV_o7y55BTu7wtbyzDU1nQcMDdYHjx8FaLCUtIH5NgZVblGVR9eBSLB-zJpYk3oEnk_fLrBVfz20mqQE3IX3kEw08ykZd38hUysPDdR_niol8cQ15JGsxxLtJXe5rM Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 2ff46475bc95496f93ad4ac4459d7cc5 Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029424536 Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:44:48.649012 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ff46475bc95496f93ad4ac4459d7cc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ff46475bc95496f93ad4ac4459d7cc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2ff46475bc95496f93ad4ac4459d7cc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2ff46475bc95496f93ad4ac4459d7cc5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029424536 Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 2ff46475bc95496f93ad4ac4459d7cc5 Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029424536 Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-ServerRescueNegativeTestJSON-1029424536-project Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 77b0df6c83a84dbcb0fa5802c93dc6ae Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029424536-project Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 could not be found. Jul 27 20:44:48.650673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '77d4ea93-fe33-426a-aa16-4ecfa7521db5'} Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 could not be found. Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:44:48.652027 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 could not be found. Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 could not be found. Jul 27 20:44:48.653644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:44:48.655127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] Returning 404 to user: Instance 77d4ea93-fe33-426a-aa16-4ecfa7521db5 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:44:48.655127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d057d939-e5dc-4683-8394-e26c6012f977 tempest-ServerRescueNegativeTestJSON-1029424536 tempest-ServerRescueNegativeTestJSON-1029424536-project] 10.222.0.47 "GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5" status: 404 len: 111 microversion: 2.1 time: 0.030512 Jul 27 20:44:48.655127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1035/2212] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:44:48 2022] GET /compute/v2.1/servers/77d4ea93-fe33-426a-aa16-4ecfa7521db5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:44:59.747335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:59.748144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:59.863307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-945973c3-d79b-4c20-8887-c15a68d7b483 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: .version_select at 0x7f35ced1a670>, body: {"keypair": {"name": "tempest-keypair-39353104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA7UyzXFdBuE8DC47Ny+Rz73//nzLFGHQPeAJZFI6Q+2VS1H1v0S4iIvgbyuapwohOA4wWOncS23YcQs/np6S+AhhsUKMKymTUXlABT3EMqsiZoRh55U7QUVFCBx7rhtw=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:44:59.879765 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-945973c3-d79b-4c20-8887-c15a68d7b483 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:44:59.883658 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-945973c3-d79b-4c20-8887-c15a68d7b483 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for user 3b94ad3c2863476ea5067d09818f66ba and project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:44:59.999377 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-945973c3-d79b-4c20-8887-c15a68d7b483 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.257315 Jul 27 20:45:00.000009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1178/2213] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:44:59 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:45:02.552194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1057773073", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e49f1bb9-b2b5-4168-baf0-0f0841df84e9"}], "security_groups": [{"name": "tempest-securitygroup--1652557331"}], "key_name": "tempest-keypair-39353104", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:02.561955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:02.562687 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:02.667715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] validate_networks() for [('e49f1bb9-b2b5-4168-baf0-0f0841df84e9', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:45:03.090744 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:45:03.091190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:45:03.091738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:45:03.092148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:45:03.092599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:45:03.102579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:03.103020 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:03.103805 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:03.104310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:03.121511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:45:03.125596 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for user 3b94ad3c2863476ea5067d09818f66ba and project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:45:03.136715 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:45:03.138999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:45:03.269841 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0e301566-ada9-49cf-b5a0-1e3e8638a864 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.721991 Jul 27 20:45:03.270542 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1036/2214] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:45:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:45:03.291267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6626bb51-2bb2-4392-b3f7-0001cb8b8d20 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:03.292478 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6626bb51-2bb2-4392-b3f7-0001cb8b8d20 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:03.356289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6626bb51-2bb2-4392-b3f7-0001cb8b8d20 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:03.363278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6626bb51-2bb2-4392-b3f7-0001cb8b8d20 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1240 microversion: 2.1 time: 0.082636 Jul 27 20:45:03.363852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1179/2215] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:03 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:04.384533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-36652299-800e-41ed-b2a4-1d714f37aab3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:04.385761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-36652299-800e-41ed-b2a4-1d714f37aab3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:04.392720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-36652299-800e-41ed-b2a4-1d714f37aab3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:04.396551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-36652299-800e-41ed-b2a4-1d714f37aab3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:04.396551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-36652299-800e-41ed-b2a4-1d714f37aab3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:04.396551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-36652299-800e-41ed-b2a4-1d714f37aab3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:04.455138 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-36652299-800e-41ed-b2a4-1d714f37aab3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:04.463689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-36652299-800e-41ed-b2a4-1d714f37aab3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1244 microversion: 2.1 time: 0.083763 Jul 27 20:45:04.464365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1037/2216] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:04 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:05.485130 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-31ac3f20-92f2-47bd-8cde-b1b674902017 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:05.486484 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-31ac3f20-92f2-47bd-8cde-b1b674902017 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:05.494013 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31ac3f20-92f2-47bd-8cde-b1b674902017 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:05.500896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31ac3f20-92f2-47bd-8cde-b1b674902017 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:05.500896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31ac3f20-92f2-47bd-8cde-b1b674902017 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:05.500896 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-31ac3f20-92f2-47bd-8cde-b1b674902017 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:05.564840 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31ac3f20-92f2-47bd-8cde-b1b674902017 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:05.572721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-31ac3f20-92f2-47bd-8cde-b1b674902017 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1310 microversion: 2.1 time: 0.091389 Jul 27 20:45:05.575463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1180/2217] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:05 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:06.601777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7c7eff28-d18b-4bf0-9dcd-5e70cb7fb54d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:06.601777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7c7eff28-d18b-4bf0-9dcd-5e70cb7fb54d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:06.606408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c7eff28-d18b-4bf0-9dcd-5e70cb7fb54d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:06.606957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c7eff28-d18b-4bf0-9dcd-5e70cb7fb54d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:06.607723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c7eff28-d18b-4bf0-9dcd-5e70cb7fb54d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:06.608159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c7eff28-d18b-4bf0-9dcd-5e70cb7fb54d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:06.805073 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7c7eff28-d18b-4bf0-9dcd-5e70cb7fb54d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:06.812578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7c7eff28-d18b-4bf0-9dcd-5e70cb7fb54d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1366 microversion: 2.1 time: 0.218065 Jul 27 20:45:06.813455 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1038/2218] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:06 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:06.968213 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-14b7ceb2-1efe-4d71-9626-f8a5b900e77b req-e0c27a53-7f98-47bb-a485-e1dd181d5954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b77117a-1852-43f9-a167-cdb98f8df67b", "tag": "6f705c18-f0e2-4036-944e-639d6f6d051d"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:06.979194 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-14b7ceb2-1efe-4d71-9626-f8a5b900e77b req-e0c27a53-7f98-47bb-a485-e1dd181d5954 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:06.979852 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-14b7ceb2-1efe-4d71-9626-f8a5b900e77b req-e0c27a53-7f98-47bb-a485-e1dd181d5954 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:06.998926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-14b7ceb2-1efe-4d71-9626-f8a5b900e77b req-e0c27a53-7f98-47bb-a485-e1dd181d5954 service nova] Creating event network-changed:6f705c18-f0e2-4036-944e-639d6f6d051d for instance 8b77117a-1852-43f9-a167-cdb98f8df67b on hv-cinder-85124 Jul 27 20:45:07.006688 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-14b7ceb2-1efe-4d71-9626-f8a5b900e77b req-e0c27a53-7f98-47bb-a485-e1dd181d5954 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044002 Jul 27 20:45:07.007909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1181/2219] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:07.833578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-028a6126-932b-41fe-bece-917b1af32fab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:07.834194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-028a6126-932b-41fe-bece-917b1af32fab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:07.840777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-028a6126-932b-41fe-bece-917b1af32fab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:07.841228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-028a6126-932b-41fe-bece-917b1af32fab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:07.841988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-028a6126-932b-41fe-bece-917b1af32fab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:07.842424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-028a6126-932b-41fe-bece-917b1af32fab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:08.235052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-028a6126-932b-41fe-bece-917b1af32fab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:08.242620 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-028a6126-932b-41fe-bece-917b1af32fab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1366 microversion: 2.1 time: 0.412792 Jul 27 20:45:08.243194 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1039/2220] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:07 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:45:09.264090 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-980fafeb-244b-4f72-9390-47bbb94f82a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:09.264818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-980fafeb-244b-4f72-9390-47bbb94f82a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:09.271329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-980fafeb-244b-4f72-9390-47bbb94f82a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:09.271989 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-980fafeb-244b-4f72-9390-47bbb94f82a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:09.272803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-980fafeb-244b-4f72-9390-47bbb94f82a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:09.273245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-980fafeb-244b-4f72-9390-47bbb94f82a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:09.400624 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-980fafeb-244b-4f72-9390-47bbb94f82a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:09.408132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-980fafeb-244b-4f72-9390-47bbb94f82a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1366 microversion: 2.1 time: 0.148648 Jul 27 20:45:09.408745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1182/2221] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:09 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:10.429853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e71fb868-6fef-4aa0-a43f-051e5525d034 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:10.430479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e71fb868-6fef-4aa0-a43f-051e5525d034 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:10.436997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e71fb868-6fef-4aa0-a43f-051e5525d034 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:10.437445 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e71fb868-6fef-4aa0-a43f-051e5525d034 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:10.438202 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e71fb868-6fef-4aa0-a43f-051e5525d034 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:10.438631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e71fb868-6fef-4aa0-a43f-051e5525d034 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:10.570103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e71fb868-6fef-4aa0-a43f-051e5525d034 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:10.577503 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e71fb868-6fef-4aa0-a43f-051e5525d034 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1366 microversion: 2.1 time: 0.152046 Jul 27 20:45:10.578071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1040/2222] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:10 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:11.598563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ca3c3bf3-c5ec-4fce-a7ca-eec1909a3f52 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:11.599122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ca3c3bf3-c5ec-4fce-a7ca-eec1909a3f52 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:11.605694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca3c3bf3-c5ec-4fce-a7ca-eec1909a3f52 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:11.606143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca3c3bf3-c5ec-4fce-a7ca-eec1909a3f52 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:11.606958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca3c3bf3-c5ec-4fce-a7ca-eec1909a3f52 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:11.607393 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca3c3bf3-c5ec-4fce-a7ca-eec1909a3f52 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:11.731890 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ca3c3bf3-c5ec-4fce-a7ca-eec1909a3f52 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:11.739243 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ca3c3bf3-c5ec-4fce-a7ca-eec1909a3f52 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1366 microversion: 2.1 time: 0.144875 Jul 27 20:45:11.739809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1183/2223] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:11 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:11.992975 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-141e4447-df10-4466-94bc-b31fd92fa8a2 req-2a09e177-2ca7-4cfb-b1be-c6d3ab66ca35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b77117a-1852-43f9-a167-cdb98f8df67b", "name": "network-vif-plugged", "status": "completed", "tag": "6f705c18-f0e2-4036-944e-639d6f6d051d"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:12.003076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-141e4447-df10-4466-94bc-b31fd92fa8a2 req-2a09e177-2ca7-4cfb-b1be-c6d3ab66ca35 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:12.003519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-141e4447-df10-4466-94bc-b31fd92fa8a2 req-2a09e177-2ca7-4cfb-b1be-c6d3ab66ca35 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:12.014192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-141e4447-df10-4466-94bc-b31fd92fa8a2 req-2a09e177-2ca7-4cfb-b1be-c6d3ab66ca35 service nova] Creating event network-vif-plugged:6f705c18-f0e2-4036-944e-639d6f6d051d for instance 8b77117a-1852-43f9-a167-cdb98f8df67b on hv-cinder-85124 Jul 27 20:45:12.019141 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-141e4447-df10-4466-94bc-b31fd92fa8a2 req-2a09e177-2ca7-4cfb-b1be-c6d3ab66ca35 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030258 Jul 27 20:45:12.019723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1041/2224] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:12.760074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dfe4696f-1433-4dd4-a829-b1b904b36cd4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:12.760737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dfe4696f-1433-4dd4-a829-b1b904b36cd4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:12.767094 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe4696f-1433-4dd4-a829-b1b904b36cd4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:12.767533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe4696f-1433-4dd4-a829-b1b904b36cd4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:12.768276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe4696f-1433-4dd4-a829-b1b904b36cd4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:12.768726 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe4696f-1433-4dd4-a829-b1b904b36cd4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:12.897110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dfe4696f-1433-4dd4-a829-b1b904b36cd4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:12.904412 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dfe4696f-1433-4dd4-a829-b1b904b36cd4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1366 microversion: 2.1 time: 0.148729 Jul 27 20:45:12.904919 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1184/2225] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:12 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:13.922874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:13.923599 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:13.927583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-34ee1828-76a4-403e-890c-cf20f900098f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:13.928480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-34ee1828-76a4-403e-890c-cf20f900098f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:13.935127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34ee1828-76a4-403e-890c-cf20f900098f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:13.935578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34ee1828-76a4-403e-890c-cf20f900098f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:13.936337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34ee1828-76a4-403e-890c-cf20f900098f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:13.936812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34ee1828-76a4-403e-890c-cf20f900098f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:14.071179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-34ee1828-76a4-403e-890c-cf20f900098f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:14.082401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-34ee1828-76a4-403e-890c-cf20f900098f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1366 microversion: 2.1 time: 0.157622 Jul 27 20:45:14.082401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1042/2226] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:13 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:15.100705 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c4e9f9c6-6b1e-4baf-9d2e-ef505f3147f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:15.101325 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c4e9f9c6-6b1e-4baf-9d2e-ef505f3147f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:15.103281 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:15.108729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4e9f9c6-6b1e-4baf-9d2e-ef505f3147f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:15.109267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4e9f9c6-6b1e-4baf-9d2e-ef505f3147f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:15.110029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4e9f9c6-6b1e-4baf-9d2e-ef505f3147f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:15.110466 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c4e9f9c6-6b1e-4baf-9d2e-ef505f3147f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:15.241501 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c4e9f9c6-6b1e-4baf-9d2e-ef505f3147f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:15.249879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c4e9f9c6-6b1e-4baf-9d2e-ef505f3147f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1557 microversion: 2.1 time: 0.153139 Jul 27 20:45:15.250449 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1185/2227] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:15 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:15.269790 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6b8b3a9b-ff3c-4d69-8035-ba22c05f8464 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:15.270300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6b8b3a9b-ff3c-4d69-8035-ba22c05f8464 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:15.279636 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b8b3a9b-ff3c-4d69-8035-ba22c05f8464 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:15.280123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b8b3a9b-ff3c-4d69-8035-ba22c05f8464 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:15.281110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b8b3a9b-ff3c-4d69-8035-ba22c05f8464 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:15.281582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b8b3a9b-ff3c-4d69-8035-ba22c05f8464 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:15.358472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6b8b3a9b-ff3c-4d69-8035-ba22c05f8464 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092442 Jul 27 20:45:15.359071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1043/2228] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 20:45:15 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:16.313772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-53323512-aeb9-435c-b2a2-20eca8d7f87a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:16.314352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-53323512-aeb9-435c-b2a2-20eca8d7f87a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:16.320729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53323512-aeb9-435c-b2a2-20eca8d7f87a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:16.321182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53323512-aeb9-435c-b2a2-20eca8d7f87a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:16.321944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53323512-aeb9-435c-b2a2-20eca8d7f87a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:16.322381 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-53323512-aeb9-435c-b2a2-20eca8d7f87a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:16.361844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-53323512-aeb9-435c-b2a2-20eca8d7f87a tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11/ips" status: 200 len: 146 microversion: 2.1 time: 0.051860 Jul 27 20:45:16.363218 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1186/2229] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:45:16 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:16.374604 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-94db629e-aa06-40bc-9007-dff2eafd4c99 req-786f5293-e111-49aa-a75d-a689cb751257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b77117a-1852-43f9-a167-cdb98f8df67b", "tag": "6f705c18-f0e2-4036-944e-639d6f6d051d"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:16.384201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-94db629e-aa06-40bc-9007-dff2eafd4c99 req-786f5293-e111-49aa-a75d-a689cb751257 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:16.384672 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-94db629e-aa06-40bc-9007-dff2eafd4c99 req-786f5293-e111-49aa-a75d-a689cb751257 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:16.395553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-94db629e-aa06-40bc-9007-dff2eafd4c99 req-786f5293-e111-49aa-a75d-a689cb751257 service nova] Creating event network-changed:6f705c18-f0e2-4036-944e-639d6f6d051d for instance 8b77117a-1852-43f9-a167-cdb98f8df67b on hv-cinder-85124 Jul 27 20:45:16.401099 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-94db629e-aa06-40bc-9007-dff2eafd4c99 req-786f5293-e111-49aa-a75d-a689cb751257 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030851 Jul 27 20:45:16.401689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1044/2230] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:52.294884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d30440a6-19cb-4ac0-8b23-cbffcbe87961 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:52.295532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d30440a6-19cb-4ac0-8b23-cbffcbe87961 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:52.297459 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:52.298123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=36 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:52.302879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d30440a6-19cb-4ac0-8b23-cbffcbe87961 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:52.308564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d30440a6-19cb-4ac0-8b23-cbffcbe87961 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:52.308564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d30440a6-19cb-4ac0-8b23-cbffcbe87961 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:52.308564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d30440a6-19cb-4ac0-8b23-cbffcbe87961 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:52.327923 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d30440a6-19cb-4ac0-8b23-cbffcbe87961 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037088 Jul 27 20:45:52.328530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1187/2231] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:45:52 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:46:16.436679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:16.437437 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=40 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:16.441499 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8c9c5486-422a-4393-bb3e-173fb4472cc0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:16.442082 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8c9c5486-422a-4393-bb3e-173fb4472cc0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:16.448115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c9c5486-422a-4393-bb3e-173fb4472cc0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:16.449060 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c9c5486-422a-4393-bb3e-173fb4472cc0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:16.449462 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c9c5486-422a-4393-bb3e-173fb4472cc0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:16.449901 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c9c5486-422a-4393-bb3e-173fb4472cc0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:16.475756 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8c9c5486-422a-4393-bb3e-173fb4472cc0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:46:16.744785 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8c9c5486-422a-4393-bb3e-173fb4472cc0 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 204 len: 0 microversion: 2.1 time: 0.309779 Jul 27 20:46:16.745379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1045/2232] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:46:16 2022] DELETE /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:46:16.753594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-03e3fa6d-35d6-4b0d-bc82-23fea2c68d9d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:16.754205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-03e3fa6d-35d6-4b0d-bc82-23fea2c68d9d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:16.761415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03e3fa6d-35d6-4b0d-bc82-23fea2c68d9d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:16.761865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03e3fa6d-35d6-4b0d-bc82-23fea2c68d9d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:16.762616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03e3fa6d-35d6-4b0d-bc82-23fea2c68d9d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:16.763049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03e3fa6d-35d6-4b0d-bc82-23fea2c68d9d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:16.889408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-03e3fa6d-35d6-4b0d-bc82-23fea2c68d9d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:16.896974 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-03e3fa6d-35d6-4b0d-bc82-23fea2c68d9d tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1673 microversion: 2.1 time: 0.147217 Jul 27 20:46:16.897553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1188/2233] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:16 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:17.920852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b2ba6a18-d673-4758-89a8-309d3dd60ead tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:17.921485 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b2ba6a18-d673-4758-89a8-309d3dd60ead tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:17.928053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2ba6a18-d673-4758-89a8-309d3dd60ead tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:17.928543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2ba6a18-d673-4758-89a8-309d3dd60ead tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:17.929306 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2ba6a18-d673-4758-89a8-309d3dd60ead tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:17.929746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2ba6a18-d673-4758-89a8-309d3dd60ead tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:18.063518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b2ba6a18-d673-4758-89a8-309d3dd60ead tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:18.071669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b2ba6a18-d673-4758-89a8-309d3dd60ead tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1673 microversion: 2.1 time: 0.155181 Jul 27 20:46:18.072235 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1046/2234] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:17 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:19.193621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d086686d-cc50-485a-b84e-bb2291e1bde4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:19.194240 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d086686d-cc50-485a-b84e-bb2291e1bde4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:19.200844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d086686d-cc50-485a-b84e-bb2291e1bde4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:19.201983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d086686d-cc50-485a-b84e-bb2291e1bde4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:19.202123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d086686d-cc50-485a-b84e-bb2291e1bde4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:19.202731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d086686d-cc50-485a-b84e-bb2291e1bde4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:19.268586 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d086686d-cc50-485a-b84e-bb2291e1bde4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:19.276626 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d086686d-cc50-485a-b84e-bb2291e1bde4 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1606 microversion: 2.1 time: 0.187928 Jul 27 20:46:19.277208 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1189/2235] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:19 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1606 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:19.382525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-5b789c6c-2ef6-40c7-bcd1-643d48916624 req-220d7e7e-7ee2-4f46-8688-1cfac8cb08fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2948a9e0-218e-47c3-ae3b-731456e37b11", "name": "network-vif-deleted", "tag": "120b2354-a6ab-4c01-bbdf-d0ff0d801962"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:46:19.398711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-5b789c6c-2ef6-40c7-bcd1-643d48916624 req-220d7e7e-7ee2-4f46-8688-1cfac8cb08fb service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:19.401349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-5b789c6c-2ef6-40c7-bcd1-643d48916624 req-220d7e7e-7ee2-4f46-8688-1cfac8cb08fb service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:19.411797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-5b789c6c-2ef6-40c7-bcd1-643d48916624 req-220d7e7e-7ee2-4f46-8688-1cfac8cb08fb service nova] Creating event network-vif-deleted:120b2354-a6ab-4c01-bbdf-d0ff0d801962 for instance 2948a9e0-218e-47c3-ae3b-731456e37b11 on hv-cinder-85124 Jul 27 20:46:19.417815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-5b789c6c-2ef6-40c7-bcd1-643d48916624 req-220d7e7e-7ee2-4f46-8688-1cfac8cb08fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039073 Jul 27 20:46:19.419074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1047/2236] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:46:20.297991 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:20.298594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:20.305708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:20.308735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:20.308735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:20.308735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:20.339133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:20.339865 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:20.342264 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lazy-loading 'fault' on Instance uuid 2948a9e0-218e-47c3-ae3b-731456e37b11 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:46:20.385448 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc262a3c3314be8a6ee620ebfa6fe85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56bf911ebbf4dd1ac5ed4bb07a9f7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:20.393072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8e505458-a573-4845-b6cb-c1c8e45c3ff3 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 200 len: 1327 microversion: 2.1 time: 0.099046 Jul 27 20:46:20.396139 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1190/2237] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:20 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:21.414507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:21.415206 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:21.421508 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:21.421960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:21.422719 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:21.423159 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:21.438464 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] HTTP exception thrown: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Request method failure captured: Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 HTTP/1.1 Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxnNd60NVMco6QozYU-27_cY-D1KwYbRUUaMsDbAMbqL46TiSS3pWUt3UED94AQ5mOGzeo3pyrbMZrgJwOiOQTpXWZVhJzK4Nvv6QSee4UTdndOrzyNzgITh-KsJa_MtAwrrKD3fztPaySTMvIiFqgE61qx9KrHscmWP-nMsXcr2Gw Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:46:21.440062 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a56bf911ebbf4dd1ac5ed4bb07a9f7b3", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 6cc262a3c3314be8a6ee620ebfa6fe85 Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:21.441934 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '2948a9e0-218e-47c3-ae3b-731456e37b11'} Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:46:21.443046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:21.445230 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:21.446626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Returning 404 to user: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:46:21.446626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4d990adb-af7d-4c31-83bf-c3ce9ae27850 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 404 len: 111 microversion: 2.1 time: 0.031812 Jul 27 20:46:21.446626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1048/2238] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:21 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:46:21.450788 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-614ecf7e-62c4-4f0b-ae5d-7a70dc9cad97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '.version_select at 0x7f35ca2c2c10>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:21.533479 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-614ecf7e-62c4-4f0b-ae5d-7a70dc9cad97 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-156220661" status: 202 len: 0 microversion: 2.1 time: 0.086463 Jul 27 20:46:21.534040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1191/2239] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Jul 27 20:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-156220661 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:46:22.526340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:22.526864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:22.533621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:22.534074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:22.534835 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:22.535296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:22.548698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] HTTP exception thrown: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Request method failure captured: Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 HTTP/1.1 Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxnNd60NVMco6QozYU-27_cY-D1KwYbRUUaMsDbAMbqL46TiSS3pWUt3UED94AQ5mOGzeo3pyrbMZrgJwOiOQTpXWZVhJzK4Nvv6QSee4UTdndOrzyNzgITh-KsJa_MtAwrrKD3fztPaySTMvIiFqgE61qx9KrHscmWP-nMsXcr2Gw Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:46:22.550246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a56bf911ebbf4dd1ac5ed4bb07a9f7b3", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 6cc262a3c3314be8a6ee620ebfa6fe85 Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '2948a9e0-218e-47c3-ae3b-731456e37b11'} Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:46:22.553071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.554871 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.556740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Returning 404 to user: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:46:22.556740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7b796374-2c0c-446f-b36c-ef6e855c61bd tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 404 len: 111 microversion: 2.1 time: 0.029551 Jul 27 20:46:22.556740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1049/2240] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:46:22 2022] DELETE /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:46:22.562544 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:22.563163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 2948a9e0-218e-47c3-ae3b-731456e37b11] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:22.570392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:22.570847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:22.571605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:22.572047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:22.584974 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] HTTP exception thrown: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Request method failure captured: Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 HTTP/1.1 Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxnNd60NVMco6QozYU-27_cY-D1KwYbRUUaMsDbAMbqL46TiSS3pWUt3UED94AQ5mOGzeo3pyrbMZrgJwOiOQTpXWZVhJzK4Nvv6QSee4UTdndOrzyNzgITh-KsJa_MtAwrrKD3fztPaySTMvIiFqgE61qx9KrHscmWP-nMsXcr2Gw Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:46:22.586596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a56bf911ebbf4dd1ac5ed4bb07a9f7b3", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 6cc262a3c3314be8a6ee620ebfa6fe85 Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.588230 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '2948a9e0-218e-47c3-ae3b-731456e37b11'} Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:46:22.589426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. Jul 27 20:46:22.590973 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:46:22.592494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Returning 404 to user: Instance 2948a9e0-218e-47c3-ae3b-731456e37b11 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:46:22.592494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-73f634e6-9f1e-4bee-864d-94888e3fef9b tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11" status: 404 len: 111 microversion: 2.1 time: 0.029833 Jul 27 20:46:22.592494 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1192/2241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:22 2022] GET /compute/v2.1/servers/2948a9e0-218e-47c3-ae3b-731456e37b11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:46:53.590902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:46:53.591699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:46:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:47:04.543801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:47:04.544532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:47:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:48:20.201376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:20.202412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:20.206383 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-72c3d1fe-26f4-499d-a006-390d71a39900 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccd4d672-b07c-4696-a8fe-3e8cca635ebc"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:20.209129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-72c3d1fe-26f4-499d-a006-390d71a39900 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:20.215255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-72c3d1fe-26f4-499d-a006-390d71a39900 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:20.215955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-72c3d1fe-26f4-499d-a006-390d71a39900 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:20.216868 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-72c3d1fe-26f4-499d-a006-390d71a39900 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:20.217504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-72c3d1fe-26f4-499d-a006-390d71a39900 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:21.566266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-72c3d1fe-26f4-499d-a006-390d71a39900 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.366455 Jul 27 20:48:21.566940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1050/2242] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:48:20 2022] POST /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments => generated 194 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:22.329525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:22.330281 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=26 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:22.335047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:22.335548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:22.349633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:22.349633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:22.349633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:22.349633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:22.357436 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef HTTP/1.1 Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:48:22.358979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.360791 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '0929536d-2d91-4e59-8f36-474025d921ef'} Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:48:22.361983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.363789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.367881 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 404 to user: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:48:22.367881 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1d95ca96-0dd4-4833-9a37-3189e835a128 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 404 len: 111 microversion: 2.20 time: 0.032779 Jul 27 20:48:22.367881 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1193/2243] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 20:48:22 2022] DELETE /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:48:22.369915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:22.370632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] [instance: 0929536d-2d91-4e59-8f36-474025d921ef] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:22.377334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:22.377784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:22.378532 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:22.378968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:22.391850 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] HTTP exception thrown: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Request method failure captured: Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef HTTP/1.1 Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZzcmRuH9iOd51uDxehNddL7oguZH-tj3ja228CrjEF8VORPzHND5cH-quQiUU3F6QhHkQhLMaOwBq9G8cy9xAsnAoss8bOG963Ucvwx6KmQ_hcp7yelurv2ZKW6dqBHZDokur4APcE8ITLDtz86fE3TCR6dCqjbjuZs9VopyWAmyN4 Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: a74675480e734145a1692641342c3e99 Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:48:22.393463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a74675480e734145a1692641342c3e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a74675480e734145a1692641342c3e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a74675480e734145a1692641342c3e99", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: a74675480e734145a1692641342c3e99 Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-840539148 Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: caca4eade01642af9322aa72f7443726 Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-840539148-project Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.395249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '0929536d-2d91-4e59-8f36-474025d921ef'} Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:48:22.396750 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. Jul 27 20:48:22.398321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:48:22.399757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] Returning 404 to user: Instance 0929536d-2d91-4e59-8f36-474025d921ef could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:48:22.399757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d1d0812e-cb7a-4ee2-8839-3e97122eb009 tempest-AttachVolumeShelveTestJSON-840539148 tempest-AttachVolumeShelveTestJSON-840539148-project] 10.222.0.47 "GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef" status: 404 len: 111 microversion: 2.20 time: 0.029300 Jul 27 20:48:22.399757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1051/2244] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 20:48:22 2022] GET /compute/v2.1/servers/0929536d-2d91-4e59-8f36-474025d921ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:48:35.479863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3aca36cc-a074-4746-8b8d-bbaeffac96bf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: .version_select at 0x7f35ca3238b0>, body: {"keypair": {"name": "tempest-keypair-1822383104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbFgFbs/sRev/oajnhmW5dUcrp39AchylQSJqgau7dm8+Yti1t0tZrO5b6L+remMb15vlPaPwzfXYusQenn2NV5LANGvpTXVj3Vsq5Hk4xVza2QTz/O4eBlur3GTeZITA=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:35.491593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0d05fc1a-7835-4fc1-aeba-023b266b5631] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 27 20:48:35.502201 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-3aca36cc-a074-4746-8b8d-bbaeffac96bf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:48:35.506073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-3aca36cc-a074-4746-8b8d-bbaeffac96bf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for user 3b94ad3c2863476ea5067d09818f66ba and project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:48:35.585111 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3aca36cc-a074-4746-8b8d-bbaeffac96bf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111789 Jul 27 20:48:35.585710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1194/2245] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:48:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:48:37.982802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-493026122", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e49f1bb9-b2b5-4168-baf0-0f0841df84e9"}], "security_groups": [{"name": "tempest-securitygroup--1188639921"}], "key_name": "tempest-keypair-1822383104", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:37.991892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:37.992566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:38.267076 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] validate_networks() for [('e49f1bb9-b2b5-4168-baf0-0f0841df84e9', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:48:38.650470 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:48:38.650836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:48:38.651310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:48:38.651771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:48:38.652185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:48:38.661115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:38.661563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:38.662359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:38.662799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:38.679936 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:48:38.683947 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for user 3b94ad3c2863476ea5067d09818f66ba and project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:48:38.695451 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:48:38.697816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:48:38.821163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-046a2413-34b5-41b5-b04f-0eda647fc78b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.842534 Jul 27 20:48:38.821811 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1052/2246] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:48:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:48:38.834784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-66322275-0488-4aee-9ea7-4599bd464c74 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:38.835557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-66322275-0488-4aee-9ea7-4599bd464c74 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:38.847734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] [0d05fc1a-7835-4fc1-aeba-023b266b5631] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 50462. Jul 27 20:48:39.007872 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-66322275-0488-4aee-9ea7-4599bd464c74 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:39.015143 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-66322275-0488-4aee-9ea7-4599bd464c74 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1241 microversion: 2.1 time: 0.185748 Jul 27 20:48:39.015844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1195/2247] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:38 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1241 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:48:40.035980 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3fbfaa37-2412-426a-9d90-017f389aba91 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:40.036653 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3fbfaa37-2412-426a-9d90-017f389aba91 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:40.044915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3fbfaa37-2412-426a-9d90-017f389aba91 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:40.045310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3fbfaa37-2412-426a-9d90-017f389aba91 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:40.046074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3fbfaa37-2412-426a-9d90-017f389aba91 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:40.046511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3fbfaa37-2412-426a-9d90-017f389aba91 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:40.109019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3fbfaa37-2412-426a-9d90-017f389aba91 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:40.117513 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3fbfaa37-2412-426a-9d90-017f389aba91 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1245 microversion: 2.1 time: 0.085518 Jul 27 20:48:40.118097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1053/2248] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:40 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:41.143492 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0b78b2ca-6a7c-4fbf-932c-ada48a270c01 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:41.143492 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0b78b2ca-6a7c-4fbf-932c-ada48a270c01 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:41.145089 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b78b2ca-6a7c-4fbf-932c-ada48a270c01 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:41.145532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b78b2ca-6a7c-4fbf-932c-ada48a270c01 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:41.146312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b78b2ca-6a7c-4fbf-932c-ada48a270c01 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:41.146738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b78b2ca-6a7c-4fbf-932c-ada48a270c01 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:41.261255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b78b2ca-6a7c-4fbf-932c-ada48a270c01 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:41.270089 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0b78b2ca-6a7c-4fbf-932c-ada48a270c01 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1311 microversion: 2.1 time: 0.135978 Jul 27 20:48:41.271938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1196/2249] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:41 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1311 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:42.292184 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6d0862e3-66c3-483f-a1ec-d7eaf8510d40 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:42.292848 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6d0862e3-66c3-483f-a1ec-d7eaf8510d40 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:42.299460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d0862e3-66c3-483f-a1ec-d7eaf8510d40 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:42.299916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d0862e3-66c3-483f-a1ec-d7eaf8510d40 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:42.300735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d0862e3-66c3-483f-a1ec-d7eaf8510d40 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:42.301181 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d0862e3-66c3-483f-a1ec-d7eaf8510d40 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:42.482251 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6d0862e3-66c3-483f-a1ec-d7eaf8510d40 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:42.494500 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6d0862e3-66c3-483f-a1ec-d7eaf8510d40 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1367 microversion: 2.1 time: 0.206248 Jul 27 20:48:42.512570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1054/2250] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:42 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:42.819653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-1fd61dcf-46b7-4624-8fcb-5cb28489b24b req-9c9826f9-cc7d-4822-b8cd-fb02fa1902b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b9d684-09f7-4fdb-b7e2-b24d69e6252f", "tag": "88032545-43a0-40ca-8e59-5b056308cf48"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:42.838352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-1fd61dcf-46b7-4624-8fcb-5cb28489b24b req-9c9826f9-cc7d-4822-b8cd-fb02fa1902b7 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:42.839330 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-1fd61dcf-46b7-4624-8fcb-5cb28489b24b req-9c9826f9-cc7d-4822-b8cd-fb02fa1902b7 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:42.853340 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-1fd61dcf-46b7-4624-8fcb-5cb28489b24b req-9c9826f9-cc7d-4822-b8cd-fb02fa1902b7 service nova] Creating event network-changed:88032545-43a0-40ca-8e59-5b056308cf48 for instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f on hv-cinder-85124 Jul 27 20:48:42.859985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-1fd61dcf-46b7-4624-8fcb-5cb28489b24b req-9c9826f9-cc7d-4822-b8cd-fb02fa1902b7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043836 Jul 27 20:48:42.861895 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1197/2251] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:43.519461 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2b2ef6ac-8274-4f56-8995-9da0a70add61 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:43.521057 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2b2ef6ac-8274-4f56-8995-9da0a70add61 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:43.536343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b2ef6ac-8274-4f56-8995-9da0a70add61 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:43.536343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b2ef6ac-8274-4f56-8995-9da0a70add61 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:43.536343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b2ef6ac-8274-4f56-8995-9da0a70add61 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:43.536343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b2ef6ac-8274-4f56-8995-9da0a70add61 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:43.747783 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2b2ef6ac-8274-4f56-8995-9da0a70add61 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:43.756878 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2b2ef6ac-8274-4f56-8995-9da0a70add61 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1367 microversion: 2.1 time: 0.243266 Jul 27 20:48:43.757487 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1055/2252] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:43 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:44.779280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-440be0be-89ef-4f4e-b0f7-4cf62179da29 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:44.780238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-440be0be-89ef-4f4e-b0f7-4cf62179da29 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:44.787412 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-440be0be-89ef-4f4e-b0f7-4cf62179da29 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:44.787976 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-440be0be-89ef-4f4e-b0f7-4cf62179da29 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:44.788789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-440be0be-89ef-4f4e-b0f7-4cf62179da29 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:44.789226 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-440be0be-89ef-4f4e-b0f7-4cf62179da29 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:44.925606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-440be0be-89ef-4f4e-b0f7-4cf62179da29 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:44.933178 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-440be0be-89ef-4f4e-b0f7-4cf62179da29 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1367 microversion: 2.1 time: 0.158893 Jul 27 20:48:44.933735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1198/2253] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:44 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:45.953791 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f3a0141d-6913-401a-8a53-25e1749a9690 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:45.954395 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f3a0141d-6913-401a-8a53-25e1749a9690 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:45.960860 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3a0141d-6913-401a-8a53-25e1749a9690 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:45.963560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3a0141d-6913-401a-8a53-25e1749a9690 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:45.963560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3a0141d-6913-401a-8a53-25e1749a9690 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:45.963560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3a0141d-6913-401a-8a53-25e1749a9690 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:46.115706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f3a0141d-6913-401a-8a53-25e1749a9690 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:46.123325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f3a0141d-6913-401a-8a53-25e1749a9690 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1367 microversion: 2.1 time: 0.173430 Jul 27 20:48:46.124282 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1056/2254] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:45 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:47.142987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-375408bf-70ec-4526-8e02-238dc538250a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:47.143596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-375408bf-70ec-4526-8e02-238dc538250a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:47.150303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-375408bf-70ec-4526-8e02-238dc538250a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:47.150719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-375408bf-70ec-4526-8e02-238dc538250a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:47.151491 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-375408bf-70ec-4526-8e02-238dc538250a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:47.151926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-375408bf-70ec-4526-8e02-238dc538250a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:47.284674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-375408bf-70ec-4526-8e02-238dc538250a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:47.293074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-375408bf-70ec-4526-8e02-238dc538250a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1367 microversion: 2.1 time: 0.153905 Jul 27 20:48:47.293649 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1199/2255] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:47 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:48.326134 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b56163c0-c0d5-45d6-9de6-2ef9b6d61da0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:48.327818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b56163c0-c0d5-45d6-9de6-2ef9b6d61da0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:48.345208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b56163c0-c0d5-45d6-9de6-2ef9b6d61da0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:48.345929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b56163c0-c0d5-45d6-9de6-2ef9b6d61da0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:48.346691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b56163c0-c0d5-45d6-9de6-2ef9b6d61da0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:48.347126 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b56163c0-c0d5-45d6-9de6-2ef9b6d61da0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:48.486476 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b56163c0-c0d5-45d6-9de6-2ef9b6d61da0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:48.494505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b56163c0-c0d5-45d6-9de6-2ef9b6d61da0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1367 microversion: 2.1 time: 0.179580 Jul 27 20:48:48.495083 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1057/2256] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:48 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:49.012261 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:49.258585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-611d07e8-6f5e-4ac6-8001-332cc2680343 req-98991a3b-f9e5-4f03-8bd3-217154b6166e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b9d684-09f7-4fdb-b7e2-b24d69e6252f", "name": "network-vif-plugged", "status": "completed", "tag": "88032545-43a0-40ca-8e59-5b056308cf48"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:49.268270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-611d07e8-6f5e-4ac6-8001-332cc2680343 req-98991a3b-f9e5-4f03-8bd3-217154b6166e service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:49.268757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-611d07e8-6f5e-4ac6-8001-332cc2680343 req-98991a3b-f9e5-4f03-8bd3-217154b6166e service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:49.280671 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-611d07e8-6f5e-4ac6-8001-332cc2680343 req-98991a3b-f9e5-4f03-8bd3-217154b6166e service nova] Creating event network-vif-plugged:88032545-43a0-40ca-8e59-5b056308cf48 for instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f on hv-cinder-85124 Jul 27 20:48:49.286260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-611d07e8-6f5e-4ac6-8001-332cc2680343 req-98991a3b-f9e5-4f03-8bd3-217154b6166e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328859 Jul 27 20:48:49.286920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1200/2257] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:49.519680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-86bb28ae-fe6d-4b5f-ad21-0dd59347b9df tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:49.521281 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-86bb28ae-fe6d-4b5f-ad21-0dd59347b9df tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:49.522468 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:49.523133 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:49.528706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86bb28ae-fe6d-4b5f-ad21-0dd59347b9df tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:49.529161 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86bb28ae-fe6d-4b5f-ad21-0dd59347b9df tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:49.529960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86bb28ae-fe6d-4b5f-ad21-0dd59347b9df tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:49.530393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-86bb28ae-fe6d-4b5f-ad21-0dd59347b9df tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:49.707093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-86bb28ae-fe6d-4b5f-ad21-0dd59347b9df tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:49.714905 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-86bb28ae-fe6d-4b5f-ad21-0dd59347b9df tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1367 microversion: 2.1 time: 0.202116 Jul 27 20:48:49.715483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1058/2258] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:49 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:50.736155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0c18ca82-d665-42ca-b3ec-4b561a03b0fc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:50.736926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0c18ca82-d665-42ca-b3ec-4b561a03b0fc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:50.744048 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c18ca82-d665-42ca-b3ec-4b561a03b0fc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:50.744546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c18ca82-d665-42ca-b3ec-4b561a03b0fc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:50.745306 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c18ca82-d665-42ca-b3ec-4b561a03b0fc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:50.745741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0c18ca82-d665-42ca-b3ec-4b561a03b0fc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:50.875127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0c18ca82-d665-42ca-b3ec-4b561a03b0fc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:50.883463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0c18ca82-d665-42ca-b3ec-4b561a03b0fc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1367 microversion: 2.1 time: 0.152129 Jul 27 20:48:50.884074 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1201/2259] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:50 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:51.904169 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e264010a-e263-4cc3-8cab-bcd41debd94c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:51.904853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e264010a-e263-4cc3-8cab-bcd41debd94c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:51.912310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e264010a-e263-4cc3-8cab-bcd41debd94c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:51.916972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e264010a-e263-4cc3-8cab-bcd41debd94c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:51.916972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e264010a-e263-4cc3-8cab-bcd41debd94c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:51.916972 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e264010a-e263-4cc3-8cab-bcd41debd94c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:52.053563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e264010a-e263-4cc3-8cab-bcd41debd94c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:52.061418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e264010a-e263-4cc3-8cab-bcd41debd94c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1558 microversion: 2.1 time: 0.161674 Jul 27 20:48:52.062005 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1059/2260] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:51 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:52.082736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-637606cf-3e09-432e-9c3e-475bbcf06e0b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:52.083942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-637606cf-3e09-432e-9c3e-475bbcf06e0b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:52.090905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-637606cf-3e09-432e-9c3e-475bbcf06e0b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:52.091352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-637606cf-3e09-432e-9c3e-475bbcf06e0b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:52.092121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-637606cf-3e09-432e-9c3e-475bbcf06e0b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:52.092621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-637606cf-3e09-432e-9c3e-475bbcf06e0b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:52.170891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-637606cf-3e09-432e-9c3e-475bbcf06e0b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092052 Jul 27 20:48:52.171497 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1202/2261] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 20:48:52 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:53.264838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-a92e971c-9daf-4da5-869d-588e361db308 req-82a6d8be-7cc5-4bb7-a234-d8f4907c75b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b9d684-09f7-4fdb-b7e2-b24d69e6252f", "tag": "88032545-43a0-40ca-8e59-5b056308cf48"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:53.274365 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-a92e971c-9daf-4da5-869d-588e361db308 req-82a6d8be-7cc5-4bb7-a234-d8f4907c75b9 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:53.274813 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-a92e971c-9daf-4da5-869d-588e361db308 req-82a6d8be-7cc5-4bb7-a234-d8f4907c75b9 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:53.285377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-a92e971c-9daf-4da5-869d-588e361db308 req-82a6d8be-7cc5-4bb7-a234-d8f4907c75b9 service nova] Creating event network-changed:88032545-43a0-40ca-8e59-5b056308cf48 for instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f on hv-cinder-85124 Jul 27 20:48:53.290987 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-a92e971c-9daf-4da5-869d-588e361db308 req-82a6d8be-7cc5-4bb7-a234-d8f4907c75b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151102 Jul 27 20:48:53.291590 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1060/2262] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:29.120405 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:29.121121 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=34 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:29.124929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c896e8c9-4333-4265-946e-791a619a9a9d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:29.125408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c896e8c9-4333-4265-946e-791a619a9a9d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:29.131880 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c896e8c9-4333-4265-946e-791a619a9a9d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.132324 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c896e8c9-4333-4265-946e-791a619a9a9d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.133098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c896e8c9-4333-4265-946e-791a619a9a9d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.133528 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c896e8c9-4333-4265-946e-791a619a9a9d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.155836 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c896e8c9-4333-4265-946e-791a619a9a9d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f/ips" status: 200 len: 150 microversion: 2.1 time: 0.037007 Jul 27 20:49:29.156425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1203/2263] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:49:29 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:29.168091 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccd4d672-b07c-4696-a8fe-3e8cca635ebc"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:29.170575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:29.172892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:29.173533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=46 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:29.178988 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.179430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.180181 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.180684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.267331 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Invalid volume: volume ccd4d672-b07c-4696-a8fe-3e8cca635ebc is already attached to instances: 8b77117a-1852-43f9-a167-cdb98f8df67b Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: POST /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f/os-volume_attachments HTTP/1.1 Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 74 Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:49:29.269174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {"volumeAttachment": {"volumeId": "ccd4d672-b07c-4696-a8fe-3e8cca635ebc"}} Jul 27 20:49:29.270955 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Invalid volume: volume ccd4d672-b07c-4696-a8fe-3e8cca635ebc is already attached to instances: 8b77117a-1852-43f9-a167-cdb98f8df67b Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'server_id': '47b9d684-09f7-4fdb-b7e2-b24d69e6252f', 'body': {'volumeAttachment': {'volumeId': 'ccd4d672-b07c-4696-a8fe-3e8cca635ebc'}}} Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ccd4d672-b07c-4696-a8fe-3e8cca635ebc is already attached to instances: 8b77117a-1852-43f9-a167-cdb98f8df67b Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:49:29.272192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ccd4d672-b07c-4696-a8fe-3e8cca635ebc is already attached to instances: 8b77117a-1852-43f9-a167-cdb98f8df67b Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:29.273891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:29.275721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:29.275721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:49:29.275721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:49:29.275721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ccd4d672-b07c-4696-a8fe-3e8cca635ebc is already attached to instances: 8b77117a-1852-43f9-a167-cdb98f8df67b Jul 27 20:49:29.275721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:49:29.275721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 400 to user: Invalid volume: volume ccd4d672-b07c-4696-a8fe-3e8cca635ebc is already attached to instances: 8b77117a-1852-43f9-a167-cdb98f8df67b {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:49:29.275721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-151a5e96-f2ab-4388-ae2e-a98a2c1c4c9b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106862 Jul 27 20:49:29.275721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1061/2264] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:49:29 2022] POST /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:49:29.279512 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6917f409-ddf7-441a-8c2f-8991cb4e24ef tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:29.280002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6917f409-ddf7-441a-8c2f-8991cb4e24ef tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:29.286983 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6917f409-ddf7-441a-8c2f-8991cb4e24ef tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.287423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6917f409-ddf7-441a-8c2f-8991cb4e24ef tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.288165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6917f409-ddf7-441a-8c2f-8991cb4e24ef tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.288637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6917f409-ddf7-441a-8c2f-8991cb4e24ef tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.312540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6917f409-ddf7-441a-8c2f-8991cb4e24ef tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:49:29.587932 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6917f409-ddf7-441a-8c2f-8991cb4e24ef tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 204 len: 0 microversion: 2.1 time: 0.312253 Jul 27 20:49:29.588732 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1204/2265] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:49:29 2022] DELETE /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:49:29.603371 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e78c5887-2cbe-42e2-a777-4d79a40ed8fe tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:29.603986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e78c5887-2cbe-42e2-a777-4d79a40ed8fe tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:29.611042 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e78c5887-2cbe-42e2-a777-4d79a40ed8fe tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.611519 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e78c5887-2cbe-42e2-a777-4d79a40ed8fe tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.612275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e78c5887-2cbe-42e2-a777-4d79a40ed8fe tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.613991 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e78c5887-2cbe-42e2-a777-4d79a40ed8fe tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.744950 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e78c5887-2cbe-42e2-a777-4d79a40ed8fe tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:29.752405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e78c5887-2cbe-42e2-a777-4d79a40ed8fe tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1682 microversion: 2.1 time: 0.153456 Jul 27 20:49:29.753221 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1062/2266] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:29 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:30.775003 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-61d3e347-d103-49ee-9300-8ee9debaf550 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:30.775680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-61d3e347-d103-49ee-9300-8ee9debaf550 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:30.782001 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61d3e347-d103-49ee-9300-8ee9debaf550 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:30.782439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61d3e347-d103-49ee-9300-8ee9debaf550 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:30.783174 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61d3e347-d103-49ee-9300-8ee9debaf550 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:30.783593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61d3e347-d103-49ee-9300-8ee9debaf550 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:30.912347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-61d3e347-d103-49ee-9300-8ee9debaf550 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:30.919682 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-61d3e347-d103-49ee-9300-8ee9debaf550 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1682 microversion: 2.1 time: 0.148829 Jul 27 20:49:30.920252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1205/2267] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:30 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:31.941727 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-28e4eb34-08c3-4df7-b0b3-ffe19ed12369 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:31.942336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-28e4eb34-08c3-4df7-b0b3-ffe19ed12369 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:31.949248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28e4eb34-08c3-4df7-b0b3-ffe19ed12369 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:31.949709 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28e4eb34-08c3-4df7-b0b3-ffe19ed12369 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:31.950472 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28e4eb34-08c3-4df7-b0b3-ffe19ed12369 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:31.950906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28e4eb34-08c3-4df7-b0b3-ffe19ed12369 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:32.105714 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-28e4eb34-08c3-4df7-b0b3-ffe19ed12369 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:32.114283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-28e4eb34-08c3-4df7-b0b3-ffe19ed12369 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1682 microversion: 2.1 time: 0.176035 Jul 27 20:49:32.114627 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1063/2268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:31 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:32.642841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-01041f5d-a98e-4a39-8f5e-177ec78ef715 req-1bfb7520-6f87-43b7-9815-e732e466c4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b9d684-09f7-4fdb-b7e2-b24d69e6252f", "name": "network-vif-deleted", "tag": "88032545-43a0-40ca-8e59-5b056308cf48"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:32.653677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-01041f5d-a98e-4a39-8f5e-177ec78ef715 req-1bfb7520-6f87-43b7-9815-e732e466c4cf service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:32.656535 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-01041f5d-a98e-4a39-8f5e-177ec78ef715 req-1bfb7520-6f87-43b7-9815-e732e466c4cf service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:32.667075 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-01041f5d-a98e-4a39-8f5e-177ec78ef715 req-1bfb7520-6f87-43b7-9815-e732e466c4cf service nova] Creating event network-vif-deleted:88032545-43a0-40ca-8e59-5b056308cf48 for instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f on hv-cinder-85124 Jul 27 20:49:32.674142 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-01041f5d-a98e-4a39-8f5e-177ec78ef715 req-1bfb7520-6f87-43b7-9815-e732e466c4cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260818 Jul 27 20:49:32.674142 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1206/2269] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:33.135032 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:33.138220 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:33.142366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:33.142818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:33.143612 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:33.144054 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:33.177820 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:33.178309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:33.178769 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lazy-loading 'fault' on Instance uuid 47b9d684-09f7-4fdb-b7e2-b24d69e6252f {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:49:33.221809 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:33.232789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9885ebb5-b12a-42b1-aaa9-41bed03e529a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 200 len: 1331 microversion: 2.1 time: 0.101703 Jul 27 20:49:33.236063 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1064/2270] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:33 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:34.255254 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:34.255940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:34.262279 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:34.262725 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:34.263476 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:34.263938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:34.277370 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f HTTP/1.1 Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:49:34.278941 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:49:34.280662 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '47b9d684-09f7-4fdb-b7e2-b24d69e6252f'} Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:49:34.281670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:49:34.283276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.285600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:49:34.285600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8567377e-c85d-430a-a224-d9f12dc53d17 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 404 len: 111 microversion: 2.1 time: 0.029686 Jul 27 20:49:34.285600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1207/2271] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:34 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:49:34.289535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cb1d9b4e-99a0-4d62-a50c-783209006c94 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '.version_select at 0x7f35cec13310>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:34.372085 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cb1d9b4e-99a0-4d62-a50c-783209006c94 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822383104" status: 202 len: 0 microversion: 2.1 time: 0.086236 Jul 27 20:49:34.372761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1065/2272] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Jul 27 20:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822383104 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:49:35.208912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ad52b290-e531-4c36-b875-d0fa9ac7bca5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:35.209418 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ad52b290-e531-4c36-b875-d0fa9ac7bca5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:35.215302 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ad52b290-e531-4c36-b875-d0fa9ac7bca5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:35.215748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ad52b290-e531-4c36-b875-d0fa9ac7bca5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:35.216519 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ad52b290-e531-4c36-b875-d0fa9ac7bca5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:35.216952 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ad52b290-e531-4c36-b875-d0fa9ac7bca5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:35.295444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-ad52b290-e531-4c36-b875-d0fa9ac7bca5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lazy-loading 'services' on Instance uuid 8b77117a-1852-43f9-a167-cdb98f8df67b {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:49:35.495508 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ad52b290-e531-4c36-b875-d0fa9ac7bca5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments/ccd4d672-b07c-4696-a8fe-3e8cca635ebc" status: 202 len: 0 microversion: 2.1 time: 0.290348 Jul 27 20:49:35.496112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1208/2273] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:49:35 2022] DELETE /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments/ccd4d672-b07c-4696-a8fe-3e8cca635ebc => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:49:35.505429 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9a473443-ce6d-4b00-9d7b-a6a9e6621030 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:35.507562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9a473443-ce6d-4b00-9d7b-a6a9e6621030 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:35.514480 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a473443-ce6d-4b00-9d7b-a6a9e6621030 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:35.514933 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a473443-ce6d-4b00-9d7b-a6a9e6621030 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:35.515762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a473443-ce6d-4b00-9d7b-a6a9e6621030 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:35.516198 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a473443-ce6d-4b00-9d7b-a6a9e6621030 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:35.547492 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9a473443-ce6d-4b00-9d7b-a6a9e6621030 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Jul 27 20:49:35.548089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1066/2274] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:49:35 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:36.560917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b48fe362-d769-4216-bdfd-469b3a1be46f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:36.563206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b48fe362-d769-4216-bdfd-469b3a1be46f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:36.569415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b48fe362-d769-4216-bdfd-469b3a1be46f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:36.569860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b48fe362-d769-4216-bdfd-469b3a1be46f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:36.570605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b48fe362-d769-4216-bdfd-469b3a1be46f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:36.571034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b48fe362-d769-4216-bdfd-469b3a1be46f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:36.599799 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b48fe362-d769-4216-bdfd-469b3a1be46f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Jul 27 20:49:36.600346 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1209/2275] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:49:36 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:37.612511 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-232ecf7b-ecb2-4599-baae-b3c6952018f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:37.614916 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-232ecf7b-ecb2-4599-baae-b3c6952018f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:37.621352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-232ecf7b-ecb2-4599-baae-b3c6952018f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:37.621792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-232ecf7b-ecb2-4599-baae-b3c6952018f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:37.622535 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-232ecf7b-ecb2-4599-baae-b3c6952018f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:37.622965 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-232ecf7b-ecb2-4599-baae-b3c6952018f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:37.650482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-232ecf7b-ecb2-4599-baae-b3c6952018f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042526 Jul 27 20:49:37.651036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1067/2276] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:49:37 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:49:37.711233 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-09b7615e-3cd6-4e0a-9fcb-3e49e9300ae2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:37.711715 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-09b7615e-3cd6-4e0a-9fcb-3e49e9300ae2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:37.718112 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09b7615e-3cd6-4e0a-9fcb-3e49e9300ae2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:37.718553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09b7615e-3cd6-4e0a-9fcb-3e49e9300ae2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:37.719303 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09b7615e-3cd6-4e0a-9fcb-3e49e9300ae2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:37.719735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-09b7615e-3cd6-4e0a-9fcb-3e49e9300ae2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:37.748972 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-09b7615e-3cd6-4e0a-9fcb-3e49e9300ae2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:49:38.011132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-09b7615e-3cd6-4e0a-9fcb-3e49e9300ae2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 204 len: 0 microversion: 2.1 time: 0.303421 Jul 27 20:49:38.011734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1210/2277] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:49:37 2022] DELETE /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:49:38.022408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3b8a3d7f-2926-4286-9e58-bd0ddabec2b1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:38.023003 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3b8a3d7f-2926-4286-9e58-bd0ddabec2b1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:38.029240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3b8a3d7f-2926-4286-9e58-bd0ddabec2b1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:38.029697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3b8a3d7f-2926-4286-9e58-bd0ddabec2b1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:38.030533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3b8a3d7f-2926-4286-9e58-bd0ddabec2b1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:38.031007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3b8a3d7f-2926-4286-9e58-bd0ddabec2b1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:38.161854 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3b8a3d7f-2926-4286-9e58-bd0ddabec2b1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:38.169301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3b8a3d7f-2926-4286-9e58-bd0ddabec2b1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1681 microversion: 2.1 time: 0.153221 Jul 27 20:49:38.169869 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1068/2278] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:38 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:39.191049 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9ec71e17-4223-493e-bb3c-30410300e7c2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:39.191654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9ec71e17-4223-493e-bb3c-30410300e7c2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:39.197845 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ec71e17-4223-493e-bb3c-30410300e7c2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:39.198283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ec71e17-4223-493e-bb3c-30410300e7c2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:39.199017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ec71e17-4223-493e-bb3c-30410300e7c2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:39.199439 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ec71e17-4223-493e-bb3c-30410300e7c2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:39.328332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9ec71e17-4223-493e-bb3c-30410300e7c2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:39.336024 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9ec71e17-4223-493e-bb3c-30410300e7c2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1681 microversion: 2.1 time: 0.149256 Jul 27 20:49:39.336757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1211/2279] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:39 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:40.358771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a1e87b72-4621-48fb-b725-229622c166e6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:40.359387 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a1e87b72-4621-48fb-b725-229622c166e6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:40.366816 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1e87b72-4621-48fb-b725-229622c166e6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:40.367268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1e87b72-4621-48fb-b725-229622c166e6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:40.368034 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1e87b72-4621-48fb-b725-229622c166e6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:40.368497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1e87b72-4621-48fb-b725-229622c166e6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:40.543929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a1e87b72-4621-48fb-b725-229622c166e6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:40.552540 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a1e87b72-4621-48fb-b725-229622c166e6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1681 microversion: 2.1 time: 0.197637 Jul 27 20:49:40.553106 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1069/2280] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:40 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:40.892493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-bc5ecb94-dd60-4112-b5eb-bceb27ba6113 req-dfe641b0-25f6-4fa2-b45f-c6a64eda75fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b77117a-1852-43f9-a167-cdb98f8df67b", "name": "network-vif-deleted", "tag": "6f705c18-f0e2-4036-944e-639d6f6d051d"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:40.903110 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-bc5ecb94-dd60-4112-b5eb-bceb27ba6113 req-dfe641b0-25f6-4fa2-b45f-c6a64eda75fe service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:40.906081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-bc5ecb94-dd60-4112-b5eb-bceb27ba6113 req-dfe641b0-25f6-4fa2-b45f-c6a64eda75fe service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:40.915634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-bc5ecb94-dd60-4112-b5eb-bceb27ba6113 req-dfe641b0-25f6-4fa2-b45f-c6a64eda75fe service nova] Creating event network-vif-deleted:6f705c18-f0e2-4036-944e-639d6f6d051d for instance 8b77117a-1852-43f9-a167-cdb98f8df67b on hv-cinder-85124 Jul 27 20:49:40.922299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-bc5ecb94-dd60-4112-b5eb-bceb27ba6113 req-dfe641b0-25f6-4fa2-b45f-c6a64eda75fe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033462 Jul 27 20:49:40.923073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1212/2281] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:41.575738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:41.575738 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:41.581836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:41.582305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:41.583078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:41.583517 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:41.617050 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:41.617504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:41.618669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lazy-loading 'fault' on Instance uuid 8b77117a-1852-43f9-a167-cdb98f8df67b {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:49:41.663808 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:41.672253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1b9d0d6c-6b40-4878-aa56-8e47a463e1cd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 200 len: 1330 microversion: 2.1 time: 0.102152 Jul 27 20:49:41.672945 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1070/2282] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:41 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:49:42.694677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:42.695375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:42.701579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:42.702029 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:42.702784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:42.703217 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:42.716020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b HTTP/1.1 Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:49:42.717619 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:49:42.719424 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '8b77117a-1852-43f9-a167-cdb98f8df67b'} Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:49:42.720667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:49:42.722572 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:49:42.724105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:49:42.724105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c6f8f005-5bc3-455a-90df-d5d8fff6b72f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 404 len: 111 microversion: 2.1 time: 0.029523 Jul 27 20:49:42.724105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1213/2283] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:42 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:49:42.727711 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ffa71944-313b-42d2-8104-4d915da64230 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '.version_select at 0x7f35cebbf9d0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:42.794697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ffa71944-313b-42d2-8104-4d915da64230 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39353104" status: 202 len: 0 microversion: 2.1 time: 0.070079 Jul 27 20:49:42.794697 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1071/2284] 10.222.0.47 () {58 vars in 1215 bytes} [Wed Jul 27 20:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39353104 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:49:43.527427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-72c56a12-25d9-46c7-aeb0-9826fd2e16a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: .version_select at 0x7f35cecd2c10>, body: {"keypair": {"name": "tempest-keypair-2009093563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8txrGa0RkEEghENKVmCh4E8A3jisG+FOfE3lByBZ2Qow9gTMKMOPq7f1aMju+dljp0AQs7jlj3YPifgPLHlW1ggwBq2OcTJ/Kw2qc+UyvjbJ30c2YVh7HS5v77txBCQQ=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:43.543137 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-72c56a12-25d9-46c7-aeb0-9826fd2e16a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:49:43.546871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-72c56a12-25d9-46c7-aeb0-9826fd2e16a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for user 3b94ad3c2863476ea5067d09818f66ba and project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:49:43.623102 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-72c56a12-25d9-46c7-aeb0-9826fd2e16a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099494 Jul 27 20:49:43.623695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1214/2285] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:49:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:45.806025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1968339791", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e49f1bb9-b2b5-4168-baf0-0f0841df84e9"}], "security_groups": [{"name": "tempest-securitygroup--512363142"}], "key_name": "tempest-keypair-2009093563", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:45.914944 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] validate_networks() for [('e49f1bb9-b2b5-4168-baf0-0f0841df84e9', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:49:46.370009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:49:46.370432 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:49:46.370930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:49:46.371364 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:49:46.371771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:49:46.381007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:46.381454 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:46.382242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:46.382677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:46.398788 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:49:46.402746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for user 3b94ad3c2863476ea5067d09818f66ba and project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:49:46.413518 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:49:46.415878 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:49:46.538115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cfb35d3b-bbd2-4a9e-884a-1947ae840b2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.737028 Jul 27 20:49:46.538861 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1072/2286] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:49:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:49:46.550118 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f7cf33f0-2fb1-4565-9418-0235715a7aec tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:46.550733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f7cf33f0-2fb1-4565-9418-0235715a7aec tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:46.605042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f7cf33f0-2fb1-4565-9418-0235715a7aec tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:46.612237 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f7cf33f0-2fb1-4565-9418-0235715a7aec tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1242 microversion: 2.1 time: 0.065955 Jul 27 20:49:46.613087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1215/2287] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:46 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:47.633826 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ce18eda3-c681-4fee-b8b2-5157eaa80481 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:47.634603 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ce18eda3-c681-4fee-b8b2-5157eaa80481 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:47.688275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ce18eda3-c681-4fee-b8b2-5157eaa80481 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:47.695676 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ce18eda3-c681-4fee-b8b2-5157eaa80481 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1242 microversion: 2.1 time: 0.066172 Jul 27 20:49:47.696245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1073/2288] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:47 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:48.715829 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-93a8fb87-ce88-4615-a8ea-ef01e76ba5ff tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:48.716472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-93a8fb87-ce88-4615-a8ea-ef01e76ba5ff tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:48.768738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-93a8fb87-ce88-4615-a8ea-ef01e76ba5ff tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:48.775352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-93a8fb87-ce88-4615-a8ea-ef01e76ba5ff tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1242 microversion: 2.1 time: 0.063281 Jul 27 20:49:48.775965 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1216/2289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:48 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:49.796720 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fb88d856-e3c2-4f02-89a7-752102e1abf1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:49.797342 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fb88d856-e3c2-4f02-89a7-752102e1abf1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:49.852077 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fb88d856-e3c2-4f02-89a7-752102e1abf1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:49.858758 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fb88d856-e3c2-4f02-89a7-752102e1abf1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1242 microversion: 2.1 time: 0.065949 Jul 27 20:49:49.859497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1074/2290] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:49 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:50.880634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c77d0267-6002-4e1e-964d-c1e0a5c222e0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:50.881244 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c77d0267-6002-4e1e-964d-c1e0a5c222e0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:50.888435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c77d0267-6002-4e1e-964d-c1e0a5c222e0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:50.888837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c77d0267-6002-4e1e-964d-c1e0a5c222e0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:50.889588 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c77d0267-6002-4e1e-964d-c1e0a5c222e0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:50.890023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c77d0267-6002-4e1e-964d-c1e0a5c222e0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:50.949312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c77d0267-6002-4e1e-964d-c1e0a5c222e0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:50.957183 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c77d0267-6002-4e1e-964d-c1e0a5c222e0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1246 microversion: 2.1 time: 0.080988 Jul 27 20:49:50.957740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1217/2291] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:50 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:51.977700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c366fcd6-2fd4-46ba-a4a9-33bed68ce8a4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:51.978507 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c366fcd6-2fd4-46ba-a4a9-33bed68ce8a4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:51.985690 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c366fcd6-2fd4-46ba-a4a9-33bed68ce8a4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:51.986798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c366fcd6-2fd4-46ba-a4a9-33bed68ce8a4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:51.987823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c366fcd6-2fd4-46ba-a4a9-33bed68ce8a4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:51.988463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c366fcd6-2fd4-46ba-a4a9-33bed68ce8a4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:52.048079 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c366fcd6-2fd4-46ba-a4a9-33bed68ce8a4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:52.056037 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c366fcd6-2fd4-46ba-a4a9-33bed68ce8a4 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1294 microversion: 2.1 time: 0.082359 Jul 27 20:49:52.056639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1075/2292] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:51 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:53.076751 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7dcbd449-3e71-450c-be6d-cc797f4aea71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:53.077352 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7dcbd449-3e71-450c-be6d-cc797f4aea71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:53.084249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7dcbd449-3e71-450c-be6d-cc797f4aea71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:53.084742 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7dcbd449-3e71-450c-be6d-cc797f4aea71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:53.085483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7dcbd449-3e71-450c-be6d-cc797f4aea71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:53.085910 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7dcbd449-3e71-450c-be6d-cc797f4aea71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:53.307364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7dcbd449-3e71-450c-be6d-cc797f4aea71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:53.315965 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7dcbd449-3e71-450c-be6d-cc797f4aea71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1367 microversion: 2.1 time: 0.242088 Jul 27 20:49:53.316819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1218/2293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:53 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:54.137912 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-f7156366-ef4b-4e0d-9e65-f0f546e6fcbb req-da1e0977-c41e-4efe-9305-e286fe45ca67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a09e857-597c-46c5-a301-f84d9fdffd7b", "tag": "2c68e02c-7af2-4cea-950e-385a7c9b971c"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:54.150600 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-f7156366-ef4b-4e0d-9e65-f0f546e6fcbb req-da1e0977-c41e-4efe-9305-e286fe45ca67 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:54.151598 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-f7156366-ef4b-4e0d-9e65-f0f546e6fcbb req-da1e0977-c41e-4efe-9305-e286fe45ca67 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:54.165667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-f7156366-ef4b-4e0d-9e65-f0f546e6fcbb req-da1e0977-c41e-4efe-9305-e286fe45ca67 service nova] Creating event network-changed:2c68e02c-7af2-4cea-950e-385a7c9b971c for instance 0a09e857-597c-46c5-a301-f84d9fdffd7b on hv-cinder-85124 Jul 27 20:49:54.171185 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-f7156366-ef4b-4e0d-9e65-f0f546e6fcbb req-da1e0977-c41e-4efe-9305-e286fe45ca67 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037819 Jul 27 20:49:54.171823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1076/2294] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:49:54.338426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c6666857-bd1d-488f-b266-a1e99ca96000 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:54.339053 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c6666857-bd1d-488f-b266-a1e99ca96000 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:54.346937 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6666857-bd1d-488f-b266-a1e99ca96000 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:54.348036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6666857-bd1d-488f-b266-a1e99ca96000 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:54.348848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6666857-bd1d-488f-b266-a1e99ca96000 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:54.349284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c6666857-bd1d-488f-b266-a1e99ca96000 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:54.770483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c6666857-bd1d-488f-b266-a1e99ca96000 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:54.777792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c6666857-bd1d-488f-b266-a1e99ca96000 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1367 microversion: 2.1 time: 0.443458 Jul 27 20:49:54.778365 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1219/2295] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:54 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:55.799800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-90796d38-f917-4585-aebc-5d6377731eb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:55.800534 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-90796d38-f917-4585-aebc-5d6377731eb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:55.806726 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90796d38-f917-4585-aebc-5d6377731eb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:55.807168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90796d38-f917-4585-aebc-5d6377731eb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:55.813115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90796d38-f917-4585-aebc-5d6377731eb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:55.813115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90796d38-f917-4585-aebc-5d6377731eb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:55.937061 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90796d38-f917-4585-aebc-5d6377731eb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:55.944493 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-90796d38-f917-4585-aebc-5d6377731eb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1367 microversion: 2.1 time: 0.149913 Jul 27 20:49:55.945109 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1077/2296] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:55 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:56.965950 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-138cf222-4237-4d41-a934-dcfd59ffaaf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:56.966562 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-138cf222-4237-4d41-a934-dcfd59ffaaf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:56.973343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-138cf222-4237-4d41-a934-dcfd59ffaaf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:56.973795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-138cf222-4237-4d41-a934-dcfd59ffaaf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:56.974548 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-138cf222-4237-4d41-a934-dcfd59ffaaf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:56.974999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-138cf222-4237-4d41-a934-dcfd59ffaaf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:57.106940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-138cf222-4237-4d41-a934-dcfd59ffaaf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:57.115605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-138cf222-4237-4d41-a934-dcfd59ffaaf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1367 microversion: 2.1 time: 0.153508 Jul 27 20:49:57.116182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1220/2297] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:56 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:58.136405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0df4e15b-3fb1-47c3-b7c6-e962894a6cab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:58.137091 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0df4e15b-3fb1-47c3-b7c6-e962894a6cab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:58.138920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:58.144924 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0df4e15b-3fb1-47c3-b7c6-e962894a6cab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:58.145376 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0df4e15b-3fb1-47c3-b7c6-e962894a6cab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:58.146135 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0df4e15b-3fb1-47c3-b7c6-e962894a6cab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:58.146578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0df4e15b-3fb1-47c3-b7c6-e962894a6cab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:58.273827 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0df4e15b-3fb1-47c3-b7c6-e962894a6cab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:58.281254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0df4e15b-3fb1-47c3-b7c6-e962894a6cab tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1367 microversion: 2.1 time: 0.148750 Jul 27 20:49:58.281982 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1078/2298] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:58 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:59.302481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f8b1c2bd-33e0-46cf-9402-5af1eabc4868 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:59.303084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f8b1c2bd-33e0-46cf-9402-5af1eabc4868 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:59.305529 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=8 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:59.306455 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:59.311157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8b1c2bd-33e0-46cf-9402-5af1eabc4868 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:59.311596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8b1c2bd-33e0-46cf-9402-5af1eabc4868 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:59.312338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8b1c2bd-33e0-46cf-9402-5af1eabc4868 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:59.312790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f8b1c2bd-33e0-46cf-9402-5af1eabc4868 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:59.316770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:59.456062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f8b1c2bd-33e0-46cf-9402-5af1eabc4868 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:59.463849 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f8b1c2bd-33e0-46cf-9402-5af1eabc4868 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1367 microversion: 2.1 time: 0.165909 Jul 27 20:49:59.464435 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1221/2299] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:59 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:50:00.486798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=10 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:50:00.542635 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ee481167-7b4a-4ee6-8f3f-1ca8e5a35a7a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:00.543315 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ee481167-7b4a-4ee6-8f3f-1ca8e5a35a7a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:00.545238 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:50:00.550828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee481167-7b4a-4ee6-8f3f-1ca8e5a35a7a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:00.551274 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee481167-7b4a-4ee6-8f3f-1ca8e5a35a7a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:00.552031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee481167-7b4a-4ee6-8f3f-1ca8e5a35a7a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:00.555224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee481167-7b4a-4ee6-8f3f-1ca8e5a35a7a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:00.556452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=81 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:50:00.683504 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ee481167-7b4a-4ee6-8f3f-1ca8e5a35a7a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:50:00.691590 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ee481167-7b4a-4ee6-8f3f-1ca8e5a35a7a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1367 microversion: 2.1 time: 0.210203 Jul 27 20:50:00.692171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1079/2300] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:50:00 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:50:01.245668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-138a8d58-e6a6-4e85-adf6-bf8468d942e2 req-45626c33-a51a-4694-9325-3d67977f980c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a09e857-597c-46c5-a301-f84d9fdffd7b", "name": "network-vif-plugged", "status": "completed", "tag": "2c68e02c-7af2-4cea-950e-385a7c9b971c"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:50:01.257145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-138a8d58-e6a6-4e85-adf6-bf8468d942e2 req-45626c33-a51a-4694-9325-3d67977f980c service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:01.257590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-138a8d58-e6a6-4e85-adf6-bf8468d942e2 req-45626c33-a51a-4694-9325-3d67977f980c service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:01.268838 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-138a8d58-e6a6-4e85-adf6-bf8468d942e2 req-45626c33-a51a-4694-9325-3d67977f980c service nova] Creating event network-vif-plugged:2c68e02c-7af2-4cea-950e-385a7c9b971c for instance 0a09e857-597c-46c5-a301-f84d9fdffd7b on hv-cinder-85124 Jul 27 20:50:01.273841 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-138a8d58-e6a6-4e85-adf6-bf8468d942e2 req-45626c33-a51a-4694-9325-3d67977f980c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032360 Jul 27 20:50:01.274417 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1222/2301] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:50:01.712073 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-073f29a9-a086-4f84-8d3a-92d4be07aa7d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:01.712787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-073f29a9-a086-4f84-8d3a-92d4be07aa7d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:01.719792 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-073f29a9-a086-4f84-8d3a-92d4be07aa7d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:01.720246 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-073f29a9-a086-4f84-8d3a-92d4be07aa7d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:01.721579 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-073f29a9-a086-4f84-8d3a-92d4be07aa7d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:01.722018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-073f29a9-a086-4f84-8d3a-92d4be07aa7d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:01.853564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-073f29a9-a086-4f84-8d3a-92d4be07aa7d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:50:01.860883 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-073f29a9-a086-4f84-8d3a-92d4be07aa7d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1367 microversion: 2.1 time: 0.152689 Jul 27 20:50:01.862155 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1080/2302] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:50:01 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:50:02.884667 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c13e31c0-7681-422f-8abb-17c57363dba3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:02.885358 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c13e31c0-7681-422f-8abb-17c57363dba3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:02.891628 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c13e31c0-7681-422f-8abb-17c57363dba3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:02.892072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c13e31c0-7681-422f-8abb-17c57363dba3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:02.892863 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c13e31c0-7681-422f-8abb-17c57363dba3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:02.893311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c13e31c0-7681-422f-8abb-17c57363dba3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:03.021984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c13e31c0-7681-422f-8abb-17c57363dba3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:50:03.029442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c13e31c0-7681-422f-8abb-17c57363dba3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1367 microversion: 2.1 time: 0.150567 Jul 27 20:50:03.030022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1223/2303] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:50:02 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:50:04.049702 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1fe6525a-f468-404e-bedf-fca77f8d1ce0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:04.050301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1fe6525a-f468-404e-bedf-fca77f8d1ce0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:04.056762 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1fe6525a-f468-404e-bedf-fca77f8d1ce0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:04.057216 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1fe6525a-f468-404e-bedf-fca77f8d1ce0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:04.057978 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1fe6525a-f468-404e-bedf-fca77f8d1ce0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:04.058417 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1fe6525a-f468-404e-bedf-fca77f8d1ce0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:04.187700 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1fe6525a-f468-404e-bedf-fca77f8d1ce0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:50:04.195642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1fe6525a-f468-404e-bedf-fca77f8d1ce0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1558 microversion: 2.1 time: 0.149887 Jul 27 20:50:04.196203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1081/2304] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:50:04 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:50:04.222723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3014437c-81ec-4875-9d59-9400690fd300 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:04.223252 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3014437c-81ec-4875-9d59-9400690fd300 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:04.229716 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3014437c-81ec-4875-9d59-9400690fd300 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:04.230164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3014437c-81ec-4875-9d59-9400690fd300 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:04.230916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3014437c-81ec-4875-9d59-9400690fd300 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:04.231356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3014437c-81ec-4875-9d59-9400690fd300 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:04.311467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3014437c-81ec-4875-9d59-9400690fd300 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092635 Jul 27 20:50:04.312068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1224/2305] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 20:50:04 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:50:05.279804 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-aa6f31c3-36b9-4d27-a11e-08be573f1220 req-a6c0f65f-2c54-4922-a278-4ab25a5b48bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a09e857-597c-46c5-a301-f84d9fdffd7b", "tag": "2c68e02c-7af2-4cea-950e-385a7c9b971c"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:50:05.290280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-aa6f31c3-36b9-4d27-a11e-08be573f1220 req-a6c0f65f-2c54-4922-a278-4ab25a5b48bc service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:05.290721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-aa6f31c3-36b9-4d27-a11e-08be573f1220 req-a6c0f65f-2c54-4922-a278-4ab25a5b48bc service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:05.302491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-aa6f31c3-36b9-4d27-a11e-08be573f1220 req-a6c0f65f-2c54-4922-a278-4ab25a5b48bc service nova] Creating event network-changed:2c68e02c-7af2-4cea-950e-385a7c9b971c for instance 0a09e857-597c-46c5-a301-f84d9fdffd7b on hv-cinder-85124 Jul 27 20:50:05.307985 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-aa6f31c3-36b9-4d27-a11e-08be573f1220 req-a6c0f65f-2c54-4922-a278-4ab25a5b48bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031876 Jul 27 20:50:05.308997 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1082/2306] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:50:13.599299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:50:13.599898 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:50:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:50:41.132971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=7 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:50:41.133639 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=17 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:50:41.137551 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ed682943-c3b1-4231-9858-93e3c4d3f138 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:41.138042 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ed682943-c3b1-4231-9858-93e3c4d3f138 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:41.143830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed682943-c3b1-4231-9858-93e3c4d3f138 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:41.144270 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed682943-c3b1-4231-9858-93e3c4d3f138 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:41.145054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed682943-c3b1-4231-9858-93e3c4d3f138 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:41.145482 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed682943-c3b1-4231-9858-93e3c4d3f138 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:41.168296 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ed682943-c3b1-4231-9858-93e3c4d3f138 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/ips" status: 200 len: 150 microversion: 2.1 time: 0.036857 Jul 27 20:50:41.168877 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1225/2307] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:50:41 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:50:42.786452 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-88d48c33-d293-4631-be03-8e327f675fa8 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97708385-652c-4b0f-8807-1f6ecf58fcc4"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:50:42.788941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-88d48c33-d293-4631-be03-8e327f675fa8 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:42.791030 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=7 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:50:42.791839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=19 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:50:42.797193 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-88d48c33-d293-4631-be03-8e327f675fa8 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:42.797655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-88d48c33-d293-4631-be03-8e327f675fa8 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:42.798407 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-88d48c33-d293-4631-be03-8e327f675fa8 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:42.798839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-88d48c33-d293-4631-be03-8e327f675fa8 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:43.400559 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-88d48c33-d293-4631-be03-8e327f675fa8 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618275 Jul 27 20:50:43.401168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1083/2308] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:50:42 2022] POST /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:50:50.959278 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97708385-652c-4b0f-8807-1f6ecf58fcc4"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:50:50.961683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:50.968868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:50.972127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:50.972127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:50.972127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:51.049531 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Invalid volume: volume 97708385-652c-4b0f-8807-1f6ecf58fcc4 is already attached to instances: 0a09e857-597c-46c5-a301-f84d9fdffd7b Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: POST /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments HTTP/1.1 Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 74 Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:50:51.051234 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {"volumeAttachment": {"volumeId": "97708385-652c-4b0f-8807-1f6ecf58fcc4"}} Jul 27 20:50:51.052971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Invalid volume: volume 97708385-652c-4b0f-8807-1f6ecf58fcc4 is already attached to instances: 0a09e857-597c-46c5-a301-f84d9fdffd7b Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'server_id': '0a09e857-597c-46c5-a301-f84d9fdffd7b', 'body': {'volumeAttachment': {'volumeId': '97708385-652c-4b0f-8807-1f6ecf58fcc4'}}} Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 97708385-652c-4b0f-8807-1f6ecf58fcc4 is already attached to instances: 0a09e857-597c-46c5-a301-f84d9fdffd7b Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:50:51.053834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 97708385-652c-4b0f-8807-1f6ecf58fcc4 is already attached to instances: 0a09e857-597c-46c5-a301-f84d9fdffd7b Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:50:51.055227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:50:51.056647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:50:51.056647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:50:51.056647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:50:51.056647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 97708385-652c-4b0f-8807-1f6ecf58fcc4 is already attached to instances: 0a09e857-597c-46c5-a301-f84d9fdffd7b Jul 27 20:50:51.056647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:50:51.056647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 400 to user: Invalid volume: volume 97708385-652c-4b0f-8807-1f6ecf58fcc4 is already attached to instances: 0a09e857-597c-46c5-a301-f84d9fdffd7b {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:50:51.056647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-51904080-d46f-4016-9e6f-8bee3e566c77 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097903 Jul 27 20:50:51.056647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1226/2309] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:50:50 2022] POST /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:50:51.118662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-202ed1b4-64d7-4a47-89ed-f194e211ef9c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:51.119398 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-202ed1b4-64d7-4a47-89ed-f194e211ef9c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:51.126340 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-202ed1b4-64d7-4a47-89ed-f194e211ef9c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:51.126856 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-202ed1b4-64d7-4a47-89ed-f194e211ef9c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:51.127628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-202ed1b4-64d7-4a47-89ed-f194e211ef9c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:51.128127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-202ed1b4-64d7-4a47-89ed-f194e211ef9c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:51.209036 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-202ed1b4-64d7-4a47-89ed-f194e211ef9c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lazy-loading 'services' on Instance uuid 0a09e857-597c-46c5-a301-f84d9fdffd7b {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:50:51.407823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-202ed1b4-64d7-4a47-89ed-f194e211ef9c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments/97708385-652c-4b0f-8807-1f6ecf58fcc4" status: 202 len: 0 microversion: 2.1 time: 0.293749 Jul 27 20:50:51.408477 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1084/2310] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:50:51 2022] DELETE /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments/97708385-652c-4b0f-8807-1f6ecf58fcc4 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:50:51.417052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dfff8152-ce5f-4d90-ac4c-3bb7af845381 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:51.419153 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dfff8152-ce5f-4d90-ac4c-3bb7af845381 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:51.425792 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfff8152-ce5f-4d90-ac4c-3bb7af845381 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:51.427953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfff8152-ce5f-4d90-ac4c-3bb7af845381 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:51.427953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfff8152-ce5f-4d90-ac4c-3bb7af845381 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:51.427953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfff8152-ce5f-4d90-ac4c-3bb7af845381 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:51.457097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dfff8152-ce5f-4d90-ac4c-3bb7af845381 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Jul 27 20:50:51.457640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1227/2311] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:50:51 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:50:52.470108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a7ae6ed1-26b4-4605-904d-b0ccb31cc808 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:52.472406 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a7ae6ed1-26b4-4605-904d-b0ccb31cc808 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:52.479114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ed1-26b4-4605-904d-b0ccb31cc808 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:52.479566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ed1-26b4-4605-904d-b0ccb31cc808 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:52.480326 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ed1-26b4-4605-904d-b0ccb31cc808 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:52.480866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ed1-26b4-4605-904d-b0ccb31cc808 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:52.510728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a7ae6ed1-26b4-4605-904d-b0ccb31cc808 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Jul 27 20:50:52.511325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1085/2312] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:50:52 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:50:53.523683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e4a3cc26-55a9-43d4-9da0-fa3d035bfcea tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:53.525847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e4a3cc26-55a9-43d4-9da0-fa3d035bfcea tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:53.532891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4a3cc26-55a9-43d4-9da0-fa3d035bfcea tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:53.533332 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4a3cc26-55a9-43d4-9da0-fa3d035bfcea tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:53.534084 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4a3cc26-55a9-43d4-9da0-fa3d035bfcea tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:53.534514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4a3cc26-55a9-43d4-9da0-fa3d035bfcea tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:53.563187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e4a3cc26-55a9-43d4-9da0-fa3d035bfcea tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043442 Jul 27 20:50:53.563727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1228/2313] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:50:53 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:50:53.623662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dde66023-1297-4a12-85f5-bc0c9f8a4394 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:53.624201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dde66023-1297-4a12-85f5-bc0c9f8a4394 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:53.630728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dde66023-1297-4a12-85f5-bc0c9f8a4394 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:53.631172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dde66023-1297-4a12-85f5-bc0c9f8a4394 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:53.631921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dde66023-1297-4a12-85f5-bc0c9f8a4394 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:53.632348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dde66023-1297-4a12-85f5-bc0c9f8a4394 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:53.659168 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dde66023-1297-4a12-85f5-bc0c9f8a4394 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:50:53.922740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dde66023-1297-4a12-85f5-bc0c9f8a4394 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 204 len: 0 microversion: 2.1 time: 0.302468 Jul 27 20:50:53.923262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1086/2314] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:50:53 2022] DELETE /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:50:53.931594 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aa6a3f88-3ebc-4687-84b2-13bef4225e32 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:53.932202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aa6a3f88-3ebc-4687-84b2-13bef4225e32 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:53.938685 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa6a3f88-3ebc-4687-84b2-13bef4225e32 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:53.939127 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa6a3f88-3ebc-4687-84b2-13bef4225e32 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:53.939874 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa6a3f88-3ebc-4687-84b2-13bef4225e32 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:53.942071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa6a3f88-3ebc-4687-84b2-13bef4225e32 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:54.072212 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aa6a3f88-3ebc-4687-84b2-13bef4225e32 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:50:54.080390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aa6a3f88-3ebc-4687-84b2-13bef4225e32 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1682 microversion: 2.1 time: 0.152628 Jul 27 20:50:54.080964 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1229/2315] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:50:53 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:50:55.101823 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a0a39b5a-bdd5-44d0-bbf2-961c7af2c816 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:55.102773 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a0a39b5a-bdd5-44d0-bbf2-961c7af2c816 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:55.108909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0a39b5a-bdd5-44d0-bbf2-961c7af2c816 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:55.109381 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0a39b5a-bdd5-44d0-bbf2-961c7af2c816 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:55.110129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0a39b5a-bdd5-44d0-bbf2-961c7af2c816 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:55.110556 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0a39b5a-bdd5-44d0-bbf2-961c7af2c816 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:55.240166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a0a39b5a-bdd5-44d0-bbf2-961c7af2c816 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:50:55.247688 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a0a39b5a-bdd5-44d0-bbf2-961c7af2c816 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1682 microversion: 2.1 time: 0.150308 Jul 27 20:50:55.248258 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1087/2316] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:50:55 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:50:56.269398 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-59f81730-e50b-475c-8c4d-f8a163b442f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:56.270034 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-59f81730-e50b-475c-8c4d-f8a163b442f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:56.276519 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59f81730-e50b-475c-8c4d-f8a163b442f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:56.276971 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59f81730-e50b-475c-8c4d-f8a163b442f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:56.277723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59f81730-e50b-475c-8c4d-f8a163b442f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:56.278154 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-59f81730-e50b-475c-8c4d-f8a163b442f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:56.456909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-59f81730-e50b-475c-8c4d-f8a163b442f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:50:56.464741 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-59f81730-e50b-475c-8c4d-f8a163b442f7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1682 microversion: 2.1 time: 0.199196 Jul 27 20:50:56.465404 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1230/2317] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:50:56 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:50:56.718081 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-e7c332d6-a660-4471-8848-65cdf4120e9b req-4e6f87fe-ca71-427a-85bb-4d97644ef61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a09e857-597c-46c5-a301-f84d9fdffd7b", "name": "network-vif-deleted", "tag": "2c68e02c-7af2-4cea-950e-385a7c9b971c"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:50:56.729935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-e7c332d6-a660-4471-8848-65cdf4120e9b req-4e6f87fe-ca71-427a-85bb-4d97644ef61e service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:56.730643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-e7c332d6-a660-4471-8848-65cdf4120e9b req-4e6f87fe-ca71-427a-85bb-4d97644ef61e service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:56.744103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-e7c332d6-a660-4471-8848-65cdf4120e9b req-4e6f87fe-ca71-427a-85bb-4d97644ef61e service nova] Creating event network-vif-deleted:2c68e02c-7af2-4cea-950e-385a7c9b971c for instance 0a09e857-597c-46c5-a301-f84d9fdffd7b on hv-cinder-85124 Jul 27 20:50:56.750468 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-e7c332d6-a660-4471-8848-65cdf4120e9b req-4e6f87fe-ca71-427a-85bb-4d97644ef61e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036049 Jul 27 20:50:56.751078 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1088/2318] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:50:57.486925 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:57.487616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:57.494375 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:57.494825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:57.495665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:57.496144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:57.527928 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:57.528367 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:57.528833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lazy-loading 'fault' on Instance uuid 0a09e857-597c-46c5-a301-f84d9fdffd7b {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:50:57.573785 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:50:57.581408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cb10b919-af12-4282-b7d9-5ec88419fe4d tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 200 len: 1332 microversion: 2.1 time: 0.099313 Jul 27 20:50:57.581978 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1231/2319] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:50:57 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:50:58.603628 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:58.604240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:50:58.611770 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:58.612215 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:58.613001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:50:58.613440 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:50:58.627010 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b HTTP/1.1 Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:50:58.628655 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:50:58.630323 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '0a09e857-597c-46c5-a301-f84d9fdffd7b'} Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:50:58.631293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:50:58.632911 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:50:58.634489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:50:58.634489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7a498518-f0c0-4944-bfe8-77e1d1e4d9a2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 404 len: 111 microversion: 2.1 time: 0.030721 Jul 27 20:50:58.634489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1089/2320] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:50:58 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:50:58.638695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-079a7ce4-b241-4bf6-9e80-12fb4c7f7f49 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '.version_select at 0x7f35ca26f700>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:50:58.694402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-079a7ce4-b241-4bf6-9e80-12fb4c7f7f49 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009093563" status: 202 len: 0 microversion: 2.1 time: 0.059360 Jul 27 20:50:58.694967 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1232/2321] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Jul 27 20:50:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009093563 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:50:59.624286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5064213b-f7e2-40d8-ad57-82d84288bb66 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: .version_select at 0x7f35ca509b80>, body: {"keypair": {"name": "tempest-keypair-1782485858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDj0ZKOOSER6BIVLrNceTfTeCGkV6Tz2MBrvR2htbsn+fis1NZ12nd2W0GWnEyJIH0YiFMkH9SxpucLhDQC2O1OdoroA10ybyd8q1Bpu5uufpGQSUjn1PtN+dEURKLSRaw=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:50:59.640463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-5064213b-f7e2-40d8-ad57-82d84288bb66 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:50:59.644293 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-5064213b-f7e2-40d8-ad57-82d84288bb66 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for user 3b94ad3c2863476ea5067d09818f66ba and project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:50:59.734624 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5064213b-f7e2-40d8-ad57-82d84288bb66 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114090 Jul 27 20:50:59.735249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1090/2322] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:50:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:01.963138 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1460835868", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e49f1bb9-b2b5-4168-baf0-0f0841df84e9"}], "security_groups": [{"name": "tempest-securitygroup--1251880825"}], "key_name": "tempest-keypair-1782485858", "user_data": "}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:02.069596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] validate_networks() for [('e49f1bb9-b2b5-4168-baf0-0f0841df84e9', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:51:02.506442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:51:02.506871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:51:02.507350 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:51:02.507760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:51:02.508171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:51:02.516955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:02.517408 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:02.518200 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:02.518635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:02.534887 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:51:02.538815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Getting quotas for user 3b94ad3c2863476ea5067d09818f66ba and project 345a49c97edc4fb7b1ce7126ce48b5b5. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:51:02.550170 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:51:02.552425 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:51:02.662348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c0a3e800-400d-4ac0-b29f-1b41fafe6bb1 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.704160 Jul 27 20:51:02.663044 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1233/2323] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:51:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:51:02.674269 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7a195a29-b950-4ab4-9d53-5bb1aa959c8a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:02.674895 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7a195a29-b950-4ab4-9d53-5bb1aa959c8a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:02.729313 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7a195a29-b950-4ab4-9d53-5bb1aa959c8a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:02.736680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7a195a29-b950-4ab4-9d53-5bb1aa959c8a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1242 microversion: 2.1 time: 0.066511 Jul 27 20:51:02.737245 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1091/2324] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:02 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:03.757010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0d9a11a1-a1c2-4461-be56-7303f81cd599 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:03.757618 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0d9a11a1-a1c2-4461-be56-7303f81cd599 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:03.809721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0d9a11a1-a1c2-4461-be56-7303f81cd599 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:03.817117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0d9a11a1-a1c2-4461-be56-7303f81cd599 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1242 microversion: 2.1 time: 0.063943 Jul 27 20:51:03.817687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1234/2325] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:03 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:04.837764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8b51556f-4528-4a30-8a6b-39dee0939f13 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:04.838605 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8b51556f-4528-4a30-8a6b-39dee0939f13 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:04.895040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8b51556f-4528-4a30-8a6b-39dee0939f13 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:04.901787 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8b51556f-4528-4a30-8a6b-39dee0939f13 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1242 microversion: 2.1 time: 0.067928 Jul 27 20:51:04.902396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1092/2326] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:04 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:05.923820 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5cf6f7b6-b1b2-41f6-8637-bbdabba70bf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:05.924372 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5cf6f7b6-b1b2-41f6-8637-bbdabba70bf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:05.981008 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5cf6f7b6-b1b2-41f6-8637-bbdabba70bf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:05.988607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5cf6f7b6-b1b2-41f6-8637-bbdabba70bf0 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1242 microversion: 2.1 time: 0.069385 Jul 27 20:51:05.989171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1235/2327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:05 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:07.009137 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cd06124f-75f3-4851-a90e-015dce16daf7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:07.009786 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cd06124f-75f3-4851-a90e-015dce16daf7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:07.017418 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd06124f-75f3-4851-a90e-015dce16daf7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:07.017879 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd06124f-75f3-4851-a90e-015dce16daf7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:07.018631 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd06124f-75f3-4851-a90e-015dce16daf7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:07.019065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd06124f-75f3-4851-a90e-015dce16daf7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:07.078265 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd06124f-75f3-4851-a90e-015dce16daf7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:07.085753 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cd06124f-75f3-4851-a90e-015dce16daf7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1246 microversion: 2.1 time: 0.080498 Jul 27 20:51:07.086325 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1093/2328] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:07 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:08.106944 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5146c7f3-8e67-4d15-96cf-3f4dd2defebd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:08.107523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5146c7f3-8e67-4d15-96cf-3f4dd2defebd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:08.114938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5146c7f3-8e67-4d15-96cf-3f4dd2defebd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:08.115392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5146c7f3-8e67-4d15-96cf-3f4dd2defebd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:08.116179 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5146c7f3-8e67-4d15-96cf-3f4dd2defebd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:08.116635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5146c7f3-8e67-4d15-96cf-3f4dd2defebd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:08.178222 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5146c7f3-8e67-4d15-96cf-3f4dd2defebd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:08.185643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5146c7f3-8e67-4d15-96cf-3f4dd2defebd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1294 microversion: 2.1 time: 0.082547 Jul 27 20:51:08.186214 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1236/2329] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:08 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:09.207119 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-347176b3-b1b4-4c24-ad56-4298120bef1e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:09.207746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-347176b3-b1b4-4c24-ad56-4298120bef1e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:09.214019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-347176b3-b1b4-4c24-ad56-4298120bef1e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:09.214465 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-347176b3-b1b4-4c24-ad56-4298120bef1e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:09.215214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-347176b3-b1b4-4c24-ad56-4298120bef1e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:09.215642 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-347176b3-b1b4-4c24-ad56-4298120bef1e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:09.289028 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-347176b3-b1b4-4c24-ad56-4298120bef1e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:09.296039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-347176b3-b1b4-4c24-ad56-4298120bef1e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1300 microversion: 2.1 time: 0.093291 Jul 27 20:51:09.296689 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1094/2330] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:09 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:10.317096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2df365f8-f2ab-4008-86dd-59f9b23b3950 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:10.317665 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2df365f8-f2ab-4008-86dd-59f9b23b3950 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:10.323573 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2df365f8-f2ab-4008-86dd-59f9b23b3950 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:10.324018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2df365f8-f2ab-4008-86dd-59f9b23b3950 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:10.324815 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2df365f8-f2ab-4008-86dd-59f9b23b3950 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:10.325299 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2df365f8-f2ab-4008-86dd-59f9b23b3950 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:10.441175 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-86422ba8-078b-4423-91bd-34f8c57e1fa7 req-a7ac3491-9d25-476e-943c-b22052914efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791d3446-8932-4752-bd20-f88048a93095", "tag": "a0219f59-da71-47a7-9013-f204df984932"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:10.456897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-86422ba8-078b-4423-91bd-34f8c57e1fa7 req-a7ac3491-9d25-476e-943c-b22052914efe service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:10.456897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-86422ba8-078b-4423-91bd-34f8c57e1fa7 req-a7ac3491-9d25-476e-943c-b22052914efe service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:10.466414 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-86422ba8-078b-4423-91bd-34f8c57e1fa7 req-a7ac3491-9d25-476e-943c-b22052914efe service nova] Creating event network-changed:a0219f59-da71-47a7-9013-f204df984932 for instance 791d3446-8932-4752-bd20-f88048a93095 on hv-cinder-85124 Jul 27 20:51:10.472930 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-86422ba8-078b-4423-91bd-34f8c57e1fa7 req-a7ac3491-9d25-476e-943c-b22052914efe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036354 Jul 27 20:51:10.474132 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1095/2331] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:51:10.543824 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2df365f8-f2ab-4008-86dd-59f9b23b3950 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:10.553695 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2df365f8-f2ab-4008-86dd-59f9b23b3950 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1368 microversion: 2.1 time: 0.240628 Jul 27 20:51:10.554608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1237/2332] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:10 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:11.575740 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-25c0bba3-4930-40fb-a398-621ae26a554a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:11.576414 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-25c0bba3-4930-40fb-a398-621ae26a554a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:11.583148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25c0bba3-4930-40fb-a398-621ae26a554a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:11.583597 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25c0bba3-4930-40fb-a398-621ae26a554a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:11.584356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25c0bba3-4930-40fb-a398-621ae26a554a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:11.584815 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-25c0bba3-4930-40fb-a398-621ae26a554a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:11.717538 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-25c0bba3-4930-40fb-a398-621ae26a554a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:11.724966 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-25c0bba3-4930-40fb-a398-621ae26a554a tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1368 microversion: 2.1 time: 0.154010 Jul 27 20:51:11.725537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1096/2333] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:11 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:12.746177 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7982ab7d-b62c-4066-adcb-7f106b5e3eda tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:12.746794 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7982ab7d-b62c-4066-adcb-7f106b5e3eda tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:12.749081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:12.753955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7982ab7d-b62c-4066-adcb-7f106b5e3eda tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:12.754403 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7982ab7d-b62c-4066-adcb-7f106b5e3eda tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:12.755160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7982ab7d-b62c-4066-adcb-7f106b5e3eda tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:12.755593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7982ab7d-b62c-4066-adcb-7f106b5e3eda tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:12.881708 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7982ab7d-b62c-4066-adcb-7f106b5e3eda tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:12.889076 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7982ab7d-b62c-4066-adcb-7f106b5e3eda tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1368 microversion: 2.1 time: 0.146732 Jul 27 20:51:12.889644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1238/2334] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:12 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:13.910798 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0a897456-0285-4ebb-8719-e5d868593804 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:13.913199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0a897456-0285-4ebb-8719-e5d868593804 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:13.913707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:13.918372 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a897456-0285-4ebb-8719-e5d868593804 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:13.918812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a897456-0285-4ebb-8719-e5d868593804 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:13.919553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a897456-0285-4ebb-8719-e5d868593804 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:13.919976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a897456-0285-4ebb-8719-e5d868593804 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:13.924701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:14.057899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0a897456-0285-4ebb-8719-e5d868593804 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:14.059900 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0a897456-0285-4ebb-8719-e5d868593804 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1368 microversion: 2.1 time: 0.153091 Jul 27 20:51:14.060497 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1097/2335] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:13 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:15.081164 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-423b223d-9d06-4e6c-956b-0af38d7d8396 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:15.081711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-423b223d-9d06-4e6c-956b-0af38d7d8396 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:15.088098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-423b223d-9d06-4e6c-956b-0af38d7d8396 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:15.088593 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-423b223d-9d06-4e6c-956b-0af38d7d8396 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:15.089356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-423b223d-9d06-4e6c-956b-0af38d7d8396 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:15.089795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-423b223d-9d06-4e6c-956b-0af38d7d8396 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:15.216096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-423b223d-9d06-4e6c-956b-0af38d7d8396 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:15.224045 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-423b223d-9d06-4e6c-956b-0af38d7d8396 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1368 microversion: 2.1 time: 0.147330 Jul 27 20:51:15.224645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1239/2336] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:15 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:16.244701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e58c2720-e0d4-46fc-be7c-72c92fcd4d31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:16.245317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e58c2720-e0d4-46fc-be7c-72c92fcd4d31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:16.247799 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=8 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:16.254637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e58c2720-e0d4-46fc-be7c-72c92fcd4d31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:16.259108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e58c2720-e0d4-46fc-be7c-72c92fcd4d31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:16.259108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e58c2720-e0d4-46fc-be7c-72c92fcd4d31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:16.259108 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e58c2720-e0d4-46fc-be7c-72c92fcd4d31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:16.389367 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e58c2720-e0d4-46fc-be7c-72c92fcd4d31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:16.397276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e58c2720-e0d4-46fc-be7c-72c92fcd4d31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1368 microversion: 2.1 time: 0.156419 Jul 27 20:51:16.397960 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1098/2337] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:16 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:17.418389 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-19c50575-3944-47cc-8acb-871dc21235bc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:17.419054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-19c50575-3944-47cc-8acb-871dc21235bc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:17.420913 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=10 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:17.426315 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19c50575-3944-47cc-8acb-871dc21235bc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:17.426760 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19c50575-3944-47cc-8acb-871dc21235bc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:17.427555 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19c50575-3944-47cc-8acb-871dc21235bc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:17.427992 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-19c50575-3944-47cc-8acb-871dc21235bc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:17.557777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-19c50575-3944-47cc-8acb-871dc21235bc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:17.565856 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-19c50575-3944-47cc-8acb-871dc21235bc tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1368 microversion: 2.1 time: 0.151369 Jul 27 20:51:17.566442 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1240/2338] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:17 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:17.676632 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-bdc16161-ef46-4389-a183-ec487eb9e8b6 req-511f94c4-db15-459c-a8a2-58150b9215a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791d3446-8932-4752-bd20-f88048a93095", "name": "network-vif-plugged", "status": "completed", "tag": "a0219f59-da71-47a7-9013-f204df984932"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:17.687102 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-bdc16161-ef46-4389-a183-ec487eb9e8b6 req-511f94c4-db15-459c-a8a2-58150b9215a6 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:17.687545 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-bdc16161-ef46-4389-a183-ec487eb9e8b6 req-511f94c4-db15-459c-a8a2-58150b9215a6 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:17.698289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-bdc16161-ef46-4389-a183-ec487eb9e8b6 req-511f94c4-db15-459c-a8a2-58150b9215a6 service nova] Creating event network-vif-plugged:a0219f59-da71-47a7-9013-f204df984932 for instance 791d3446-8932-4752-bd20-f88048a93095 on hv-cinder-85124 Jul 27 20:51:17.704016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-bdc16161-ef46-4389-a183-ec487eb9e8b6 req-511f94c4-db15-459c-a8a2-58150b9215a6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031260 Jul 27 20:51:17.704641 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1099/2339] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:18.587059 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-27b36d5a-64f7-49a1-8462-3059e1610c31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:18.587664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-27b36d5a-64f7-49a1-8462-3059e1610c31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:18.594729 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27b36d5a-64f7-49a1-8462-3059e1610c31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:18.595109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27b36d5a-64f7-49a1-8462-3059e1610c31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:18.595844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27b36d5a-64f7-49a1-8462-3059e1610c31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:18.596269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-27b36d5a-64f7-49a1-8462-3059e1610c31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:18.725409 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-27b36d5a-64f7-49a1-8462-3059e1610c31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:18.732680 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-27b36d5a-64f7-49a1-8462-3059e1610c31 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1368 microversion: 2.1 time: 0.149391 Jul 27 20:51:18.733280 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1241/2340] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:18 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:19.756509 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-99277067-1b3f-4ef7-bf52-f47a7ab4db18 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:19.757226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-99277067-1b3f-4ef7-bf52-f47a7ab4db18 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:19.763333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99277067-1b3f-4ef7-bf52-f47a7ab4db18 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:19.763810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99277067-1b3f-4ef7-bf52-f47a7ab4db18 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:19.765199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99277067-1b3f-4ef7-bf52-f47a7ab4db18 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:19.765657 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99277067-1b3f-4ef7-bf52-f47a7ab4db18 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:19.897355 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-99277067-1b3f-4ef7-bf52-f47a7ab4db18 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:19.904751 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-99277067-1b3f-4ef7-bf52-f47a7ab4db18 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1368 microversion: 2.1 time: 0.152885 Jul 27 20:51:19.905917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1100/2341] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:19 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:20.925869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bda1a777-33f2-40d3-91a9-c31773c15491 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:20.926411 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bda1a777-33f2-40d3-91a9-c31773c15491 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:20.941657 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bda1a777-33f2-40d3-91a9-c31773c15491 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:20.942105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bda1a777-33f2-40d3-91a9-c31773c15491 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:20.942868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bda1a777-33f2-40d3-91a9-c31773c15491 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:20.943301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bda1a777-33f2-40d3-91a9-c31773c15491 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:21.078615 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bda1a777-33f2-40d3-91a9-c31773c15491 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:21.080803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=85 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:21.086579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bda1a777-33f2-40d3-91a9-c31773c15491 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1559 microversion: 2.1 time: 0.164625 Jul 27 20:51:21.087155 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1242/2342] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:20 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:21.108746 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6237460c-3a46-4a11-bff5-9f791418fde2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:21.109273 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6237460c-3a46-4a11-bff5-9f791418fde2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:21.115989 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6237460c-3a46-4a11-bff5-9f791418fde2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:21.116460 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6237460c-3a46-4a11-bff5-9f791418fde2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:21.117208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6237460c-3a46-4a11-bff5-9f791418fde2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:21.117633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6237460c-3a46-4a11-bff5-9f791418fde2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:21.192999 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6237460c-3a46-4a11-bff5-9f791418fde2 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088645 Jul 27 20:51:21.193615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1101/2343] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 20:51:21 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:22.152640 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-4d1d4a8c-d21e-4ef6-ac3e-8e4d047439df req-56692873-8f84-4cd2-98ee-1a8d6e1464d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791d3446-8932-4752-bd20-f88048a93095", "tag": "a0219f59-da71-47a7-9013-f204df984932"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:22.158790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:22.163902 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-4d1d4a8c-d21e-4ef6-ac3e-8e4d047439df req-56692873-8f84-4cd2-98ee-1a8d6e1464d4 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:22.164335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-4d1d4a8c-d21e-4ef6-ac3e-8e4d047439df req-56692873-8f84-4cd2-98ee-1a8d6e1464d4 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:22.175130 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-4d1d4a8c-d21e-4ef6-ac3e-8e4d047439df req-56692873-8f84-4cd2-98ee-1a8d6e1464d4 service nova] Creating event network-changed:a0219f59-da71-47a7-9013-f204df984932 for instance 791d3446-8932-4752-bd20-f88048a93095 on hv-cinder-85124 Jul 27 20:51:22.188850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-4d1d4a8c-d21e-4ef6-ac3e-8e4d047439df req-56692873-8f84-4cd2-98ee-1a8d6e1464d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031208 Jul 27 20:51:22.188850 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1243/2344] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:59.241342 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=9 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:59.242129 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=23 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:59.246052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-663d41bc-63af-474e-9fa3-f228cc97b2a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:59.246550 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-663d41bc-63af-474e-9fa3-f228cc97b2a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:59.253031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-663d41bc-63af-474e-9fa3-f228cc97b2a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:59.259255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-663d41bc-63af-474e-9fa3-f228cc97b2a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:59.259255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-663d41bc-63af-474e-9fa3-f228cc97b2a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:59.259255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-663d41bc-63af-474e-9fa3-f228cc97b2a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:59.276887 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-663d41bc-63af-474e-9fa3-f228cc97b2a6 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/ips" status: 200 len: 151 microversion: 2.1 time: 0.037078 Jul 27 20:51:59.277454 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1102/2345] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 20:51:59 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:00.820245 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:52:00.824868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c53cd182-db38-49c3-8bd9-d18c9323459c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f062986-973f-4bf5-a561-9f80423cc98d"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:52:00.827288 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c53cd182-db38-49c3-8bd9-d18c9323459c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:00.834140 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c53cd182-db38-49c3-8bd9-d18c9323459c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:00.834585 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c53cd182-db38-49c3-8bd9-d18c9323459c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:00.835335 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c53cd182-db38-49c3-8bd9-d18c9323459c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:00.835769 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c53cd182-db38-49c3-8bd9-d18c9323459c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:01.649114 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c53cd182-db38-49c3-8bd9-d18c9323459c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "POST /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830358 Jul 27 20:52:01.649790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1244/2346] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:52:00 2022] POST /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments => generated 194 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:09.271800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-75dfc75d-af88-45f2-af82-2306fd6ef729 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:09.272401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-75dfc75d-af88-45f2-af82-2306fd6ef729 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:09.279839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75dfc75d-af88-45f2-af82-2306fd6ef729 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:09.280289 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75dfc75d-af88-45f2-af82-2306fd6ef729 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:09.281098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75dfc75d-af88-45f2-af82-2306fd6ef729 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:09.281523 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-75dfc75d-af88-45f2-af82-2306fd6ef729 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:09.370031 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-75dfc75d-af88-45f2-af82-2306fd6ef729 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lazy-loading 'services' on Instance uuid 791d3446-8932-4752-bd20-f88048a93095 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:52:09.633354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-75dfc75d-af88-45f2-af82-2306fd6ef729 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments/4f062986-973f-4bf5-a561-9f80423cc98d" status: 202 len: 0 microversion: 2.1 time: 0.365254 Jul 27 20:52:09.633952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1103/2347] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:52:09 2022] DELETE /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments/4f062986-973f-4bf5-a561-9f80423cc98d => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:52:09.643876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7a17106e-3d90-4876-99b5-6024adc32629 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:09.646150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7a17106e-3d90-4876-99b5-6024adc32629 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:09.653002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7a17106e-3d90-4876-99b5-6024adc32629 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:09.653456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7a17106e-3d90-4876-99b5-6024adc32629 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:09.654830 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7a17106e-3d90-4876-99b5-6024adc32629 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:09.655803 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7a17106e-3d90-4876-99b5-6024adc32629 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:09.687026 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7a17106e-3d90-4876-99b5-6024adc32629 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048456 Jul 27 20:52:09.687600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1245/2348] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:52:09 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:10.700192 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cfcc45ef-6055-461a-8e27-6aab951fb1c7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:10.702543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cfcc45ef-6055-461a-8e27-6aab951fb1c7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:10.708742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfcc45ef-6055-461a-8e27-6aab951fb1c7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:10.709191 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfcc45ef-6055-461a-8e27-6aab951fb1c7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:10.709956 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfcc45ef-6055-461a-8e27-6aab951fb1c7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:10.710392 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cfcc45ef-6055-461a-8e27-6aab951fb1c7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:10.739359 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cfcc45ef-6055-461a-8e27-6aab951fb1c7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Jul 27 20:52:10.739920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1104/2349] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:52:10 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:11.751339 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bb7f68bf-4dd5-4f1d-bf1b-fe8e11503a2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:11.753569 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bb7f68bf-4dd5-4f1d-bf1b-fe8e11503a2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:11.760107 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bb7f68bf-4dd5-4f1d-bf1b-fe8e11503a2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:11.760602 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bb7f68bf-4dd5-4f1d-bf1b-fe8e11503a2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:11.761355 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bb7f68bf-4dd5-4f1d-bf1b-fe8e11503a2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:11.761793 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bb7f68bf-4dd5-4f1d-bf1b-fe8e11503a2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:11.789269 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bb7f68bf-4dd5-4f1d-bf1b-fe8e11503a2f tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041945 Jul 27 20:52:11.789825 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1246/2350] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:52:11 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:52:11.850249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a8b3ce4c-a541-4498-8e2a-e5e5c5b4fd5b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:11.850772 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a8b3ce4c-a541-4498-8e2a-e5e5c5b4fd5b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:11.857123 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8b3ce4c-a541-4498-8e2a-e5e5c5b4fd5b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:11.857563 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8b3ce4c-a541-4498-8e2a-e5e5c5b4fd5b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:11.858358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8b3ce4c-a541-4498-8e2a-e5e5c5b4fd5b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:11.858812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8b3ce4c-a541-4498-8e2a-e5e5c5b4fd5b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:11.884255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a8b3ce4c-a541-4498-8e2a-e5e5c5b4fd5b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:52:12.193874 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a8b3ce4c-a541-4498-8e2a-e5e5c5b4fd5b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 204 len: 0 microversion: 2.1 time: 0.347105 Jul 27 20:52:12.194473 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1105/2351] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:52:11 2022] DELETE /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:52:12.203223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ca424d28-ee6d-4220-badb-447d728d6279 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:12.203832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ca424d28-ee6d-4220-badb-447d728d6279 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:12.209819 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca424d28-ee6d-4220-badb-447d728d6279 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:12.210268 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca424d28-ee6d-4220-badb-447d728d6279 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:12.211019 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca424d28-ee6d-4220-badb-447d728d6279 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:12.211454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ca424d28-ee6d-4220-badb-447d728d6279 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:12.342152 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ca424d28-ee6d-4220-badb-447d728d6279 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:52:12.350138 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ca424d28-ee6d-4220-badb-447d728d6279 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1684 microversion: 2.1 time: 0.151366 Jul 27 20:52:12.350711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1247/2352] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:12 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:52:13.372580 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-feb9fff3-f5ec-4566-8644-349f57a9d45b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:13.373339 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-feb9fff3-f5ec-4566-8644-349f57a9d45b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:13.380213 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-feb9fff3-f5ec-4566-8644-349f57a9d45b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:13.380698 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-feb9fff3-f5ec-4566-8644-349f57a9d45b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:13.381456 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-feb9fff3-f5ec-4566-8644-349f57a9d45b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:13.381891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-feb9fff3-f5ec-4566-8644-349f57a9d45b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:13.512935 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-feb9fff3-f5ec-4566-8644-349f57a9d45b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:52:13.520448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-feb9fff3-f5ec-4566-8644-349f57a9d45b tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1684 microversion: 2.1 time: 0.152099 Jul 27 20:52:13.521017 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1106/2353] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:13 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:52:14.542025 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5582420c-5958-4243-9f35-131a530489fd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:14.542591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5582420c-5958-4243-9f35-131a530489fd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:14.549449 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5582420c-5958-4243-9f35-131a530489fd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:14.549897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5582420c-5958-4243-9f35-131a530489fd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:14.550653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5582420c-5958-4243-9f35-131a530489fd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:14.551091 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5582420c-5958-4243-9f35-131a530489fd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:14.748717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5582420c-5958-4243-9f35-131a530489fd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:52:14.756353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5582420c-5958-4243-9f35-131a530489fd tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1684 microversion: 2.1 time: 0.218297 Jul 27 20:52:14.758406 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1248/2354] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:14 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1684 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:52:15.165410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-20e7c1b5-57ae-4639-87e7-16572367f7f8 req-27640525-73ed-425f-8876-8c8646f1015d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791d3446-8932-4752-bd20-f88048a93095", "name": "network-vif-deleted", "tag": "a0219f59-da71-47a7-9013-f204df984932"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:52:15.175344 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-20e7c1b5-57ae-4639-87e7-16572367f7f8 req-27640525-73ed-425f-8876-8c8646f1015d service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:15.175786 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-20e7c1b5-57ae-4639-87e7-16572367f7f8 req-27640525-73ed-425f-8876-8c8646f1015d service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:15.187190 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-20e7c1b5-57ae-4639-87e7-16572367f7f8 req-27640525-73ed-425f-8876-8c8646f1015d service nova] Creating event network-vif-deleted:a0219f59-da71-47a7-9013-f204df984932 for instance 791d3446-8932-4752-bd20-f88048a93095 on hv-cinder-85124 Jul 27 20:52:15.192155 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-20e7c1b5-57ae-4639-87e7-16572367f7f8 req-27640525-73ed-425f-8876-8c8646f1015d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030331 Jul 27 20:52:15.192788 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1107/2355] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:15.777801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:15.778396 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:15.785596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:15.786093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:15.786858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:15.787294 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:15.820647 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:15.821095 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:15.821549 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lazy-loading 'fault' on Instance uuid 791d3446-8932-4752-bd20-f88048a93095 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:52:15.864017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b94ad3c2863476ea5067d09818f66ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a49c97edc4fb7b1ce7126ce48b5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:52:15.871727 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2b3c331b-1a07-4201-8321-e86c4a5e8bb7 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 200 len: 1332 microversion: 2.1 time: 0.097947 Jul 27 20:52:15.872311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1249/2356] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:15 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:52:16.893843 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:16.894539 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:16.900745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:16.901186 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:16.901929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:16.902358 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:16.915602 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 HTTP/1.1 Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:52:16.917189 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:16.918941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '791d3446-8932-4752-bd20-f88048a93095'} Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:16.920051 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:16.922537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:16.924148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:16.924148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a385e9df-f65e-49b3-a796-63d228a2847c tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 404 len: 111 microversion: 2.1 time: 0.029486 Jul 27 20:52:16.924148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1108/2357] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:16 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:52:16.927970 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0738c34f-092f-4fe9-ae78-0f4dc09d2521 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '.version_select at 0x7f35cec81d30>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:17.034236 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0738c34f-092f-4fe9-ae78-0f4dc09d2521 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782485858" status: 202 len: 0 microversion: 2.1 time: 0.110059 Jul 27 20:52:17.035287 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1250/2358] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Jul 27 20:52:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782485858 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:52:18.989453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:18.989946 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:18.996224 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:18.996707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:18.997451 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:18.997883 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:19.010851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 HTTP/1.1 Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:52:19.012349 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.014647 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '791d3446-8932-4752-bd20-f88048a93095'} Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:19.015833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.017567 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.019166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:19.019166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9c6c225c-5907-42ba-95a4-2443cb72ba8e tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 404 len: 111 microversion: 2.1 time: 0.028090 Jul 27 20:52:19.019166 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1109/2359] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:52:18 2022] DELETE /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:52:19.022444 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:19.023047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 791d3446-8932-4752-bd20-f88048a93095] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:19.030675 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:19.031117 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:19.031860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:19.032285 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:19.044822 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 HTTP/1.1 Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:52:19.046472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.048251 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '791d3446-8932-4752-bd20-f88048a93095'} Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:19.049275 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. Jul 27 20:52:19.050612 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:19.051987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 791d3446-8932-4752-bd20-f88048a93095 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:19.051987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1ee200ad-dc22-4b29-a5d0-f2e2d4ad3363 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095" status: 404 len: 111 microversion: 2.1 time: 0.029115 Jul 27 20:52:19.051987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1251/2360] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:19 2022] GET /compute/v2.1/servers/791d3446-8932-4752-bd20-f88048a93095 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:52:20.323016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:20.323522 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:20.330637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:20.331089 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:20.331853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:20.332291 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:20.346311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b HTTP/1.1 Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:52:20.347888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.349639 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '0a09e857-597c-46c5-a301-f84d9fdffd7b'} Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:20.350734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.352335 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.354059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:20.354059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-213274a0-3ece-46f8-b25a-7f590f2d2d71 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 404 len: 111 microversion: 2.1 time: 0.030166 Jul 27 20:52:20.354059 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1110/2361] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:52:20 2022] DELETE /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:52:20.357623 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:20.358232 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 0a09e857-597c-46c5-a301-f84d9fdffd7b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:20.364654 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:20.365097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:20.365835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:20.366260 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:20.380704 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b HTTP/1.1 Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:52:20.382318 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.384022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '0a09e857-597c-46c5-a301-f84d9fdffd7b'} Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:20.385068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. Jul 27 20:52:20.386453 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.387770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 0a09e857-597c-46c5-a301-f84d9fdffd7b could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:20.387770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f7789ac7-6ec7-4b3b-bbd3-e1de48608bdf tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b" status: 404 len: 111 microversion: 2.1 time: 0.029783 Jul 27 20:52:20.387770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1252/2362] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:20 2022] GET /compute/v2.1/servers/0a09e857-597c-46c5-a301-f84d9fdffd7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:52:20.392539 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:20.393038 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:20.398996 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:20.399448 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:20.400197 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:20.400667 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:20.414338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f HTTP/1.1 Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:52:20.415852 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.417634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '47b9d684-09f7-4fdb-b7e2-b24d69e6252f'} Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:20.418619 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.420354 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.422180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:20.422180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0c1af192-c3cc-4909-88c4-29812da0b2c5 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 404 len: 111 microversion: 2.1 time: 0.029048 Jul 27 20:52:20.422180 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1111/2363] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:52:20 2022] DELETE /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 20:52:20.425844 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:20.426456 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 47b9d684-09f7-4fdb-b7e2-b24d69e6252f] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:20.432503 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:20.432953 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:20.433698 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:20.434132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:20.447096 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f HTTP/1.1 Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:52:20.448646 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.450364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '47b9d684-09f7-4fdb-b7e2-b24d69e6252f'} Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:20.451463 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. Jul 27 20:52:20.453630 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:20.455267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 47b9d684-09f7-4fdb-b7e2-b24d69e6252f could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:20.455267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d395ebad-2d15-4191-88d5-da9d32d987e3 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f" status: 404 len: 111 microversion: 2.1 time: 0.028029 Jul 27 20:52:20.455267 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1253/2364] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:20 2022] GET /compute/v2.1/servers/47b9d684-09f7-4fdb-b7e2-b24d69e6252f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:52:21.688074 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:21.688613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:21.695057 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:21.695505 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:21.696262 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:21.696735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:21.712167 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b HTTP/1.1 Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:52:21.713728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.715543 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '8b77117a-1852-43f9-a167-cdb98f8df67b'} Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:21.716570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.717888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.721142 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:21.721142 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e6fbba82-2ec4-4633-91ce-d663658bbd47 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 404 len: 111 microversion: 2.1 time: 0.030888 Jul 27 20:52:21.721142 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1112/2365] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:52:21 2022] DELETE /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:52:21.726485 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:21.727111 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] [instance: 8b77117a-1852-43f9-a167-cdb98f8df67b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:21.733604 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:21.734057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:21.734818 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:21.735507 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:21.748762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] HTTP exception thrown: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Request method failure captured: Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b HTTP/1.1 Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4aPLDNKrKIdZjgpyujawoCbBeUAmQoQqfHLZvc0shwdb72VW4_bLb8hZQtjHcFIHsKuyydg2Aicz3bsssmLK0DBOSrcJivnhPTvg2tApHe5Csk_wOkUEGCL0ZCGmucVkQtcH8lWjQK-HlD2yULEPPdoojUo6DEk-4TEiayMM5UN8Jeo Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:52:21.750284 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/345a49c97edc4fb7b1ce7126ce48b5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_345a49c97edc4fb7b1ce7126ce48b5b5", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 345a49c97edc4fb7b1ce7126ce48b5b5 Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-903353500 Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 3b94ad3c2863476ea5067d09818f66ba Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-903353500-project Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.751963 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '8b77117a-1852-43f9-a167-cdb98f8df67b'} Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:21.754611 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. Jul 27 20:52:21.756206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:21.758126 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] Returning 404 to user: Instance 8b77117a-1852-43f9-a167-cdb98f8df67b could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:21.758126 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-74315139-3a50-4a90-9865-c99e760a6ff9 tempest-AttachVolumeNegativeTest-903353500 tempest-AttachVolumeNegativeTest-903353500-project] 10.222.0.47 "GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b" status: 404 len: 111 microversion: 2.1 time: 0.031546 Jul 27 20:52:21.758126 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1254/2366] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:21 2022] GET /compute/v2.1/servers/8b77117a-1852-43f9-a167-cdb98f8df67b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 20:52:43.694902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:43.694902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:43.697122 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:52:43.697780 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:52:43.702925 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:43.703374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:43.704146 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:43.705111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:43.718585 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] HTTP exception thrown: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Request method failure captured: Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d HTTP/1.1 Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4ZxnNd60NVMco6QozYU-27_cY-D1KwYbRUUaMsDbAMbqL46TiSS3pWUt3UED94AQ5mOGzeo3pyrbMZrgJwOiOQTpXWZVhJzK4Nvv6QSee4UTdndOrzyNzgITh-KsJa_MtAwrrKD3fztPaySTMvIiFqgE61qx9KrHscmWP-nMsXcr2Gw Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:52:43.720775 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a56bf911ebbf4dd1ac5ed4bb07a9f7b3", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 6cc262a3c3314be8a6ee620ebfa6fe85 Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.722415 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d'} Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:43.723310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.724897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.726853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Returning 404 to user: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:43.726853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fba41404-a14c-4701-bcb8-5bd7dbb80051 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 404 len: 111 microversion: 2.1 time: 0.032183 Jul 27 20:52:43.726853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1113/2367] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:52:43 2022] DELETE /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:52:43.731093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:43.731701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] [instance: 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:52:43.733935 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:52:43.737867 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:52:43.740098 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:43.740592 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:43.741359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:52:43.741790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:52:43.756027 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] HTTP exception thrown: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Request method failure captured: Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d HTTP/1.1 Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4ZxnNd60NVMco6QozYU-27_cY-D1KwYbRUUaMsDbAMbqL46TiSS3pWUt3UED94AQ5mOGzeo3pyrbMZrgJwOiOQTpXWZVhJzK4Nvv6QSee4UTdndOrzyNzgITh-KsJa_MtAwrrKD3fztPaySTMvIiFqgE61qx9KrHscmWP-nMsXcr2Gw Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:52:43.757450 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a56bf911ebbf4dd1ac5ed4bb07a9f7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a56bf911ebbf4dd1ac5ed4bb07a9f7b3", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: a56bf911ebbf4dd1ac5ed4bb07a9f7b3 Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285165730 Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 6cc262a3c3314be8a6ee620ebfa6fe85 Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeTestJSON-285165730-project Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.759255 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'id': '0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d'} Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:52:43.760105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. Jul 27 20:52:43.761770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:52:43.762979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] Returning 404 to user: Instance 0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:52:43.762979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-418a9757-84b1-46b3-ab67-57c40ca057e7 tempest-AttachVolumeTestJSON-285165730 tempest-AttachVolumeTestJSON-285165730-project] 10.222.0.47 "GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d" status: 404 len: 111 microversion: 2.1 time: 0.031828 Jul 27 20:52:43.762979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1255/2368] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:52:43 2022] GET /compute/v2.1/servers/0905fbd6-8afd-4b3e-acdc-45ad18bc9d1d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:52:51.162384 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6371ecc3-597a-4eee-b113-a5816bd9dd6f tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35cad8f5e0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:51.213000 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6371ecc3-597a-4eee-b113-a5816bd9dd6f tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/14dc3401-8d11-4371-a47b-66a00521cf09" status: 200 len: 350 microversion: 2.1 time: 0.055055 Jul 27 20:52:51.213566 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1114/2369] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:52:51 2022] GET /compute/v2.1/os-volumes/14dc3401-8d11-4371-a47b-66a00521cf09 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:52.863423 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0f9a4318-1b86-4e03-b1f0-f3250943bf91 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35ca3145e0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:52.911319 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0f9a4318-1b86-4e03-b1f0-f3250943bf91 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c6a80d56-43c6-4175-88cf-2eb068b315e8" status: 200 len: 350 microversion: 2.1 time: 0.052669 Jul 27 20:52:52.913805 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1256/2370] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:52:52 2022] GET /compute/v2.1/os-volumes/c6a80d56-43c6-4175-88cf-2eb068b315e8 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:54.519393 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ebdea12e-da8d-4ba9-97a6-7dcd4a006f65 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35ca302a60>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:54.566319 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ebdea12e-da8d-4ba9-97a6-7dcd4a006f65 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/fbd1a4f5-9a73-43cd-aa95-41e1ba87e48b" status: 200 len: 350 microversion: 2.1 time: 0.052603 Jul 27 20:52:54.566889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1115/2371] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 20:52:54 2022] GET /compute/v2.1/os-volumes/fbd1a4f5-9a73-43cd-aa95-41e1ba87e48b => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:54.580912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b0a3c920-12cd-443e-82b5-b6f84dea3887 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35ceccef70>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:54.663078 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b0a3c920-12cd-443e-82b5-b6f84dea3887 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.087577 Jul 27 20:52:54.663875 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1257/2372] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Jul 27 20:52:54 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:52:54.678015 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bcefbec4-42c4-4e9f-965b-0144491c6a81 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35ca4b0700>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:54.761321 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bcefbec4-42c4-4e9f-965b-0144491c6a81 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087801 Jul 27 20:52:54.761887 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1116/2373] 10.222.0.47 () {58 vars in 1149 bytes} [Wed Jul 27 20:52:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:54.774733 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73654b7b-d44b-4666-bb08-5b9da937151a tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35ca314ca0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:54.860224 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-73654b7b-d44b-4666-bb08-5b9da937151a tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.089172 Jul 27 20:52:54.861371 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1258/2374] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Jul 27 20:52:54 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:52:54.873704 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6a9c17c2-f31e-4b89-b86c-04f1475b75d6 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35ca5094c0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:54.958837 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6a9c17c2-f31e-4b89-b86c-04f1475b75d6 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088815 Jul 27 20:52:54.959412 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1117/2375] 10.222.0.47 () {58 vars in 1167 bytes} [Wed Jul 27 20:52:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:54.972430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ddfb7822-e5e1-4fb5-a73c-2218cc5ff140 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35ca2c2670>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:55.056000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ddfb7822-e5e1-4fb5-a73c-2218cc5ff140 tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087213 Jul 27 20:52:55.056648 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1259/2376] 10.222.0.47 () {58 vars in 1170 bytes} [Wed Jul 27 20:52:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:55.070150 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-44281cea-6bf9-4231-a88d-fc9c98f21fcf tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35cebbf3a0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:55.150583 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-44281cea-6bf9-4231-a88d-fc9c98f21fcf tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084072 Jul 27 20:52:55.151156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1118/2377] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Jul 27 20:52:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:52:55.163728 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b866f278-3caa-4b24-9427-77f3a765078e tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35ca259e50>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:55.246095 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b866f278-3caa-4b24-9427-77f3a765078e tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086108 Jul 27 20:52:55.246677 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1260/2378] 10.222.0.47 () {58 vars in 1188 bytes} [Wed Jul 27 20:52:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:52:55.260025 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-384f3892-1a52-4a8a-af8f-7c8c24f30dfa tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] Calling method '.version_select at 0x7f35ca4b0dc0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:52:55.349940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-384f3892-1a52-4a8a-af8f-7c8c24f30dfa tempest-VolumesTestJSON-1839738219 tempest-VolumesTestJSON-1839738219-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.093742 Jul 27 20:52:55.350510 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1119/2379] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Jul 27 20:52:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:02.882247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1418665192", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "networks": [{"uuid": "0cf86a2f-7800-46cc-ad11-d86eb777dd31"}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:02.939028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] validate_networks() for [('0cf86a2f-7800-46cc-ad11-d86eb777dd31', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:53:03.299550 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:53:03.299975 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:53:03.300482 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:53:03.301523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:53:03.301523 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:53:03.310552 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:03.311005 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:03.311801 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:03.312238 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:03.331087 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Getting quotas for project ab2db90ccbbf468587d34d323c7bcd8a. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:53:03.335248 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Getting quotas for user bffda1c5c6644b98a4b46c45d5e80a73 and project ab2db90ccbbf468587d34d323c7bcd8a. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:53:03.347414 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:53:03.349184 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:53:03.467893 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e7aee61f-5780-4fa1-b678-aa0fbd69888b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590176 Jul 27 20:53:03.472839 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1261/2380] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:53:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:53:03.480232 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ea8bfaf7-61c3-482a-8cc4-66058b879204 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:03.480974 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ea8bfaf7-61c3-482a-8cc4-66058b879204 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:03.537466 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ea8bfaf7-61c3-482a-8cc4-66058b879204 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:03.545881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ea8bfaf7-61c3-482a-8cc4-66058b879204 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1214 microversion: 2.1 time: 0.070379 Jul 27 20:53:03.546453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1120/2381] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:03 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:04.567204 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7264b00c-6ef3-4bf3-8561-ea72138a9740 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:04.567810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7264b00c-6ef3-4bf3-8561-ea72138a9740 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:04.573853 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7264b00c-6ef3-4bf3-8561-ea72138a9740 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:04.574300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7264b00c-6ef3-4bf3-8561-ea72138a9740 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:04.575043 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7264b00c-6ef3-4bf3-8561-ea72138a9740 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:04.575474 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7264b00c-6ef3-4bf3-8561-ea72138a9740 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:04.639374 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7264b00c-6ef3-4bf3-8561-ea72138a9740 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:04.647385 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7264b00c-6ef3-4bf3-8561-ea72138a9740 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1218 microversion: 2.1 time: 0.084501 Jul 27 20:53:04.647955 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1262/2382] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:04 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:05.668776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d12f6c71-e6bc-4dec-addb-caf4ddf4e4e6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:05.669360 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d12f6c71-e6bc-4dec-addb-caf4ddf4e4e6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:05.671644 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:05.677851 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d12f6c71-e6bc-4dec-addb-caf4ddf4e4e6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:05.678296 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d12f6c71-e6bc-4dec-addb-caf4ddf4e4e6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:05.679041 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d12f6c71-e6bc-4dec-addb-caf4ddf4e4e6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:05.679471 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d12f6c71-e6bc-4dec-addb-caf4ddf4e4e6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:05.750950 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d12f6c71-e6bc-4dec-addb-caf4ddf4e4e6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:05.758266 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d12f6c71-e6bc-4dec-addb-caf4ddf4e4e6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1266 microversion: 2.1 time: 0.093444 Jul 27 20:53:05.761607 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1121/2383] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:05 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:06.779826 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-abed1af3-7fe0-4ec8-a892-32498de4eae9 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:06.780483 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-abed1af3-7fe0-4ec8-a892-32498de4eae9 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:06.791539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abed1af3-7fe0-4ec8-a892-32498de4eae9 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:06.795858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abed1af3-7fe0-4ec8-a892-32498de4eae9 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:06.795858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abed1af3-7fe0-4ec8-a892-32498de4eae9 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:06.795858 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abed1af3-7fe0-4ec8-a892-32498de4eae9 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:07.003762 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-abed1af3-7fe0-4ec8-a892-32498de4eae9 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:07.011142 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-abed1af3-7fe0-4ec8-a892-32498de4eae9 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1314 microversion: 2.1 time: 0.236029 Jul 27 20:53:07.011721 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1263/2384] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:06 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:07.628927 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-2be6e268-7f09-4b1c-932f-a271c86efa88 req-abdd4b42-c6ac-4df6-ace4-acb6fd7fa605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea41095f-683a-43b3-89bd-17e1693d2fff", "tag": "02778e49-ea11-4b7b-998a-409b2d37f329"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:07.638993 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2be6e268-7f09-4b1c-932f-a271c86efa88 req-abdd4b42-c6ac-4df6-ace4-acb6fd7fa605 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:07.639728 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2be6e268-7f09-4b1c-932f-a271c86efa88 req-abdd4b42-c6ac-4df6-ace4-acb6fd7fa605 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:07.653241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-2be6e268-7f09-4b1c-932f-a271c86efa88 req-abdd4b42-c6ac-4df6-ace4-acb6fd7fa605 service nova] Creating event network-changed:02778e49-ea11-4b7b-998a-409b2d37f329 for instance ea41095f-683a-43b3-89bd-17e1693d2fff on hv-cinder-85124 Jul 27 20:53:07.659760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-2be6e268-7f09-4b1c-932f-a271c86efa88 req-abdd4b42-c6ac-4df6-ace4-acb6fd7fa605 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033899 Jul 27 20:53:07.659760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1122/2385] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:53:08.035040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2e861543-567d-4278-9b77-ad4d135d457f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:08.035669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2e861543-567d-4278-9b77-ad4d135d457f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:08.042482 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e861543-567d-4278-9b77-ad4d135d457f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:08.042930 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e861543-567d-4278-9b77-ad4d135d457f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:08.043710 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e861543-567d-4278-9b77-ad4d135d457f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:08.044133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e861543-567d-4278-9b77-ad4d135d457f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:08.251038 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2e861543-567d-4278-9b77-ad4d135d457f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:08.261246 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2e861543-567d-4278-9b77-ad4d135d457f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1314 microversion: 2.1 time: 0.230070 Jul 27 20:53:08.261831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1264/2386] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:08 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:09.283678 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f777f8f2-0c77-413e-ac24-779b0d66bdbd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:09.284396 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f777f8f2-0c77-413e-ac24-779b0d66bdbd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:09.290594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f777f8f2-0c77-413e-ac24-779b0d66bdbd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:09.291047 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f777f8f2-0c77-413e-ac24-779b0d66bdbd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:09.291802 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f777f8f2-0c77-413e-ac24-779b0d66bdbd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:09.292239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f777f8f2-0c77-413e-ac24-779b0d66bdbd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:09.426248 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f777f8f2-0c77-413e-ac24-779b0d66bdbd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:09.433587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f777f8f2-0c77-413e-ac24-779b0d66bdbd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1314 microversion: 2.1 time: 0.155220 Jul 27 20:53:09.434352 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1123/2387] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:09 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:10.457999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-235bce6b-ef1c-4d2e-b93f-deaa1000a5ab tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:10.458603 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-235bce6b-ef1c-4d2e-b93f-deaa1000a5ab tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:10.464683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-235bce6b-ef1c-4d2e-b93f-deaa1000a5ab tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:10.465136 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-235bce6b-ef1c-4d2e-b93f-deaa1000a5ab tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:10.465884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-235bce6b-ef1c-4d2e-b93f-deaa1000a5ab tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:10.466311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-235bce6b-ef1c-4d2e-b93f-deaa1000a5ab tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:10.597707 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-235bce6b-ef1c-4d2e-b93f-deaa1000a5ab tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:10.605023 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-235bce6b-ef1c-4d2e-b93f-deaa1000a5ab tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1314 microversion: 2.1 time: 0.150886 Jul 27 20:53:10.605596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1265/2388] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:10 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:11.627124 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dd1975f8-e8e8-455e-a175-ff3996a8650d tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:11.627670 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dd1975f8-e8e8-455e-a175-ff3996a8650d tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:11.634244 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd1975f8-e8e8-455e-a175-ff3996a8650d tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:11.634691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd1975f8-e8e8-455e-a175-ff3996a8650d tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:11.635442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd1975f8-e8e8-455e-a175-ff3996a8650d tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:11.635878 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd1975f8-e8e8-455e-a175-ff3996a8650d tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:11.764902 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dd1975f8-e8e8-455e-a175-ff3996a8650d tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:11.773068 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dd1975f8-e8e8-455e-a175-ff3996a8650d tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1314 microversion: 2.1 time: 0.150393 Jul 27 20:53:11.773782 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1124/2389] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:11 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:12.793789 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1ba6c8e7-b4bf-48b7-bd67-90d506019e56 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:12.794481 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1ba6c8e7-b4bf-48b7-bd67-90d506019e56 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:12.801509 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ba6c8e7-b4bf-48b7-bd67-90d506019e56 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:12.801977 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ba6c8e7-b4bf-48b7-bd67-90d506019e56 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:12.802777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ba6c8e7-b4bf-48b7-bd67-90d506019e56 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:12.803147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ba6c8e7-b4bf-48b7-bd67-90d506019e56 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:12.934616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1ba6c8e7-b4bf-48b7-bd67-90d506019e56 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:12.942537 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1ba6c8e7-b4bf-48b7-bd67-90d506019e56 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1314 microversion: 2.1 time: 0.152740 Jul 27 20:53:12.943115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1266/2390] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:12 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:13.962889 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2c705d54-2007-48b3-838e-c3655cc21c45 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:13.963601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2c705d54-2007-48b3-838e-c3655cc21c45 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:13.965713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:13.971065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c705d54-2007-48b3-838e-c3655cc21c45 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:13.971533 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c705d54-2007-48b3-838e-c3655cc21c45 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:13.972276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c705d54-2007-48b3-838e-c3655cc21c45 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:13.972730 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c705d54-2007-48b3-838e-c3655cc21c45 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:14.107379 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2c705d54-2007-48b3-838e-c3655cc21c45 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:14.115328 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2c705d54-2007-48b3-838e-c3655cc21c45 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1314 microversion: 2.1 time: 0.156220 Jul 27 20:53:14.116286 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1125/2391] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:13 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:14.291759 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-479634f8-11e7-4fc8-855d-cfb402546384 req-a31950e3-be5c-4820-b8b4-7067fe52d8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea41095f-683a-43b3-89bd-17e1693d2fff", "name": "network-vif-plugged", "status": "completed", "tag": "02778e49-ea11-4b7b-998a-409b2d37f329"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:14.297835 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:14.298560 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:14.303099 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-479634f8-11e7-4fc8-855d-cfb402546384 req-a31950e3-be5c-4820-b8b4-7067fe52d8eb service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:14.303534 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-479634f8-11e7-4fc8-855d-cfb402546384 req-a31950e3-be5c-4820-b8b4-7067fe52d8eb service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:14.314336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-479634f8-11e7-4fc8-855d-cfb402546384 req-a31950e3-be5c-4820-b8b4-7067fe52d8eb service nova] Creating event network-vif-plugged:02778e49-ea11-4b7b-998a-409b2d37f329 for instance ea41095f-683a-43b3-89bd-17e1693d2fff on hv-cinder-85124 Jul 27 20:53:14.319378 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-479634f8-11e7-4fc8-855d-cfb402546384 req-a31950e3-be5c-4820-b8b4-7067fe52d8eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031297 Jul 27 20:53:14.320668 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1267/2392] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:53:15.140973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5405c34b-2587-44f0-8031-dfa43851926e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:15.140973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5405c34b-2587-44f0-8031-dfa43851926e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:15.143969 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5405c34b-2587-44f0-8031-dfa43851926e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:15.144444 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5405c34b-2587-44f0-8031-dfa43851926e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:15.145204 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5405c34b-2587-44f0-8031-dfa43851926e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:15.145649 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5405c34b-2587-44f0-8031-dfa43851926e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:15.284199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5405c34b-2587-44f0-8031-dfa43851926e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:15.291479 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5405c34b-2587-44f0-8031-dfa43851926e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1314 microversion: 2.1 time: 0.159123 Jul 27 20:53:15.292115 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1126/2393] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:15 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:53:16.314336 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d1c9a5d5-cb2f-401f-a19d-819dc0df4ada tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:16.315113 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d1c9a5d5-cb2f-401f-a19d-819dc0df4ada tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:16.321795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1c9a5d5-cb2f-401f-a19d-819dc0df4ada tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:16.322247 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1c9a5d5-cb2f-401f-a19d-819dc0df4ada tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:16.322998 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1c9a5d5-cb2f-401f-a19d-819dc0df4ada tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:16.323470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1c9a5d5-cb2f-401f-a19d-819dc0df4ada tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:16.455061 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d1c9a5d5-cb2f-401f-a19d-819dc0df4ada tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:16.462731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d1c9a5d5-cb2f-401f-a19d-819dc0df4ada tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1314 microversion: 2.1 time: 0.154373 Jul 27 20:53:16.463397 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1268/2394] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:16 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:17.484103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-734307ab-ce9c-45f6-85a7-62dc4b9488ad tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:17.484734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-734307ab-ce9c-45f6-85a7-62dc4b9488ad tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:17.491968 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-734307ab-ce9c-45f6-85a7-62dc4b9488ad tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:17.492453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-734307ab-ce9c-45f6-85a7-62dc4b9488ad tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:17.493199 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-734307ab-ce9c-45f6-85a7-62dc4b9488ad tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:17.493626 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-734307ab-ce9c-45f6-85a7-62dc4b9488ad tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:17.622237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-734307ab-ce9c-45f6-85a7-62dc4b9488ad tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:17.629976 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-734307ab-ce9c-45f6-85a7-62dc4b9488ad tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1498 microversion: 2.1 time: 0.150198 Jul 27 20:53:17.633707 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1127/2395] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:17 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:18.482868 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-be7dbec7-27b6-4999-802e-823b4d88a00c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:18.483390 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-be7dbec7-27b6-4999-802e-823b4d88a00c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:18.491564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be7dbec7-27b6-4999-802e-823b4d88a00c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:18.491564 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be7dbec7-27b6-4999-802e-823b4d88a00c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:18.491886 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be7dbec7-27b6-4999-802e-823b4d88a00c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:18.492445 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-be7dbec7-27b6-4999-802e-823b4d88a00c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:18.518851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-be7dbec7-27b6-4999-802e-823b4d88a00c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:53:18.911018 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-be7dbec7-27b6-4999-802e-823b4d88a00c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 204 len: 0 microversion: 2.1 time: 0.431827 Jul 27 20:53:18.911653 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1269/2396] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:53:18 2022] DELETE /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:53:18.919860 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e05d3346-d0b4-4194-909e-94edfd19e96b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:18.920621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e05d3346-d0b4-4194-909e-94edfd19e96b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:18.928272 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e05d3346-d0b4-4194-909e-94edfd19e96b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:18.928741 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e05d3346-d0b4-4194-909e-94edfd19e96b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:18.929494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e05d3346-d0b4-4194-909e-94edfd19e96b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:18.929920 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e05d3346-d0b4-4194-909e-94edfd19e96b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:19.108251 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e05d3346-d0b4-4194-909e-94edfd19e96b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:19.116601 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e05d3346-d0b4-4194-909e-94edfd19e96b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1504 microversion: 2.1 time: 0.200432 Jul 27 20:53:19.117139 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1128/2397] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:18 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:53:20.137701 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f086ffdd-996d-4b41-969f-04359ff16a60 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:20.138492 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f086ffdd-996d-4b41-969f-04359ff16a60 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:20.145157 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f086ffdd-996d-4b41-969f-04359ff16a60 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:20.145605 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f086ffdd-996d-4b41-969f-04359ff16a60 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:20.146342 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f086ffdd-996d-4b41-969f-04359ff16a60 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:20.146772 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f086ffdd-996d-4b41-969f-04359ff16a60 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:20.276661 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f086ffdd-996d-4b41-969f-04359ff16a60 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:20.295347 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f086ffdd-996d-4b41-969f-04359ff16a60 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1504 microversion: 2.1 time: 0.151217 Jul 27 20:53:20.296010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1270/2398] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:20 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:53:21.051087 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-813657de-5ff8-445b-a0bd-c603a79e921a req-59aa485c-293d-4c9e-857b-62cb50dd24db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea41095f-683a-43b3-89bd-17e1693d2fff", "name": "network-vif-deleted", "tag": "02778e49-ea11-4b7b-998a-409b2d37f329"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:21.064942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-813657de-5ff8-445b-a0bd-c603a79e921a req-59aa485c-293d-4c9e-857b-62cb50dd24db service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:21.064942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-813657de-5ff8-445b-a0bd-c603a79e921a req-59aa485c-293d-4c9e-857b-62cb50dd24db service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:21.073537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-813657de-5ff8-445b-a0bd-c603a79e921a req-59aa485c-293d-4c9e-857b-62cb50dd24db service nova] Creating event network-vif-deleted:02778e49-ea11-4b7b-998a-409b2d37f329 for instance ea41095f-683a-43b3-89bd-17e1693d2fff on hv-cinder-85124 Jul 27 20:53:21.078578 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-813657de-5ff8-445b-a0bd-c603a79e921a req-59aa485c-293d-4c9e-857b-62cb50dd24db service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031080 Jul 27 20:53:21.079836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1129/2399] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:53:21.319915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b7cb045a-0ff9-41a0-956a-b6a3cbd1d726 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:21.319915 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b7cb045a-0ff9-41a0-956a-b6a3cbd1d726 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:21.325344 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7cb045a-0ff9-41a0-956a-b6a3cbd1d726 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:21.325687 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7cb045a-0ff9-41a0-956a-b6a3cbd1d726 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:21.326454 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7cb045a-0ff9-41a0-956a-b6a3cbd1d726 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:21.326892 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7cb045a-0ff9-41a0-956a-b6a3cbd1d726 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:21.403051 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b7cb045a-0ff9-41a0-956a-b6a3cbd1d726 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:21.412730 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b7cb045a-0ff9-41a0-956a-b6a3cbd1d726 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 200 len: 1299 microversion: 2.1 time: 0.099207 Jul 27 20:53:21.413329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1271/2400] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:21 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:22.434005 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:22.434684 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: ea41095f-683a-43b3-89bd-17e1693d2fff] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:22.440853 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:22.441301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:22.451501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:22.451501 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:22.456682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] HTTP exception thrown: Instance ea41095f-683a-43b3-89bd-17e1693d2fff could not be found. Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Request method failure captured: Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff HTTP/1.1 Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aWsxC1umVpyZ7SwchNqazJ3owJsM4heBVNHL1abOq5wr5aOffT3-E5R0je29X4UQqL7C3inTV2UJvkifV1XkOujj1P_B6pJ4MA617YAEm3jM80q6HZ0lIKZMlANZzDOEWraonDCCrhgAlTT7TJAPgF79L64GEhRCfiQKkgXVEPiWKg Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: ab2db90ccbbf468587d34d323c7bcd8a Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesActionsTest-1732949642 Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:53:22.458336 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2db90ccbbf468587d34d323c7bcd8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2db90ccbbf468587d34d323c7bcd8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab2db90ccbbf468587d34d323c7bcd8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab2db90ccbbf468587d34d323c7bcd8a", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesActionsTest-1732949642 Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: ab2db90ccbbf468587d34d323c7bcd8a Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesActionsTest-1732949642 Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesActionsTest-1732949642-project Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: bffda1c5c6644b98a4b46c45d5e80a73 Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesActionsTest-1732949642-project Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance ea41095f-683a-43b3-89bd-17e1693d2fff could not be found. Jul 27 20:53:22.461242 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': 'ea41095f-683a-43b3-89bd-17e1693d2fff'} Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea41095f-683a-43b3-89bd-17e1693d2fff could not be found. Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:53:22.462776 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea41095f-683a-43b3-89bd-17e1693d2fff could not be found. Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea41095f-683a-43b3-89bd-17e1693d2fff could not be found. Jul 27 20:53:22.466416 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:22.470009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Returning 404 to user: Instance ea41095f-683a-43b3-89bd-17e1693d2fff could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:53:22.470009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e309431f-d83c-475b-99b6-e101a5c4a903 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff" status: 404 len: 111 microversion: 2.1 time: 0.030563 Jul 27 20:53:22.470009 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1130/2401] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:22 2022] GET /compute/v2.1/servers/ea41095f-683a-43b3-89bd-17e1693d2fff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:53:22.560633 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1524738683", "imageRef": "631cbefe-b76a-4022-a29c-85f2395bea8f", "flavorRef": "452", "networks": [{"uuid": "0cf86a2f-7800-46cc-ad11-d86eb777dd31"}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:22.617109 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] validate_networks() for [('0cf86a2f-7800-46cc-ad11-d86eb777dd31', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:53:23.238940 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:53:23.239308 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:53:23.239810 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:53:23.240289 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:53:23.240669 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:53:23.249737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:23.250186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:23.251761 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:23.252195 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:23.268553 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Getting quotas for project ab2db90ccbbf468587d34d323c7bcd8a. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:53:23.272502 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Getting quotas for user bffda1c5c6644b98a4b46c45d5e80a73 and project ab2db90ccbbf468587d34d323c7bcd8a. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:53:23.283392 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:53:23.285664 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='631cbefe-b76a-4022-a29c-85f2395bea8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:53:23.427122 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1d82a22e-22be-4d62-abad-c54f873b3314 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870751 Jul 27 20:53:23.427782 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1272/2402] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:53:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:53:23.439453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fa061b6a-3589-4fd9-ad39-b0f994a89c64 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:23.440513 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fa061b6a-3589-4fd9-ad39-b0f994a89c64 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:23.507801 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fa061b6a-3589-4fd9-ad39-b0f994a89c64 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:23.515680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fa061b6a-3589-4fd9-ad39-b0f994a89c64 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1214 microversion: 2.1 time: 0.081006 Jul 27 20:53:23.525847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1131/2403] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:23 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:24.537259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-81f77987-59b1-488f-a702-b5687107920f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:24.538173 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-81f77987-59b1-488f-a702-b5687107920f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:24.545533 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81f77987-59b1-488f-a702-b5687107920f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:24.545985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81f77987-59b1-488f-a702-b5687107920f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:24.546745 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81f77987-59b1-488f-a702-b5687107920f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:24.547182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-81f77987-59b1-488f-a702-b5687107920f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:24.640644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-81f77987-59b1-488f-a702-b5687107920f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:24.645009 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:24.649513 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-81f77987-59b1-488f-a702-b5687107920f tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1218 microversion: 2.1 time: 0.116392 Jul 27 20:53:24.650100 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1273/2404] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:24 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:25.670908 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-99bf2319-2d64-4a34-929d-6f76fcfe1880 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:25.671613 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-99bf2319-2d64-4a34-929d-6f76fcfe1880 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:25.677110 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=31 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:25.680040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99bf2319-2d64-4a34-929d-6f76fcfe1880 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:25.680040 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99bf2319-2d64-4a34-929d-6f76fcfe1880 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:25.680866 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99bf2319-2d64-4a34-929d-6f76fcfe1880 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:25.681645 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99bf2319-2d64-4a34-929d-6f76fcfe1880 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:25.763208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-99bf2319-2d64-4a34-929d-6f76fcfe1880 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:25.774803 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-99bf2319-2d64-4a34-929d-6f76fcfe1880 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1274 microversion: 2.1 time: 0.108486 Jul 27 20:53:25.776842 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1132/2405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:25 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:26.804430 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f07c8df9-1ff0-4e9b-be39-78eb26a0424b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:26.805171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f07c8df9-1ff0-4e9b-be39-78eb26a0424b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:26.807328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:26.812486 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f07c8df9-1ff0-4e9b-be39-78eb26a0424b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:26.812984 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f07c8df9-1ff0-4e9b-be39-78eb26a0424b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:26.813736 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f07c8df9-1ff0-4e9b-be39-78eb26a0424b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:26.814165 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f07c8df9-1ff0-4e9b-be39-78eb26a0424b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:26.949681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f07c8df9-1ff0-4e9b-be39-78eb26a0424b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:26.957458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f07c8df9-1ff0-4e9b-be39-78eb26a0424b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1314 microversion: 2.1 time: 0.157320 Jul 27 20:53:26.958022 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1274/2406] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:26 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:27.288211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-9cd7a644-3ebb-4e33-8ca6-5490991dc47b req-80aaa7e9-7867-4f6f-a2fe-841d0943708a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f01bb51-435e-4cbb-9192-02357f5d538e", "tag": "85c6d52b-ae0f-41dc-b6a2-79af91a8e5dc"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:27.302029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-9cd7a644-3ebb-4e33-8ca6-5490991dc47b req-80aaa7e9-7867-4f6f-a2fe-841d0943708a service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:27.302562 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-9cd7a644-3ebb-4e33-8ca6-5490991dc47b req-80aaa7e9-7867-4f6f-a2fe-841d0943708a service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:27.319290 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-9cd7a644-3ebb-4e33-8ca6-5490991dc47b req-80aaa7e9-7867-4f6f-a2fe-841d0943708a service nova] Creating event network-changed:85c6d52b-ae0f-41dc-b6a2-79af91a8e5dc for instance 4f01bb51-435e-4cbb-9192-02357f5d538e on hv-cinder-85124 Jul 27 20:53:27.324287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-9cd7a644-3ebb-4e33-8ca6-5490991dc47b req-80aaa7e9-7867-4f6f-a2fe-841d0943708a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040148 Jul 27 20:53:27.324915 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1133/2407] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:53:27.979942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ed6ed8c-e484-4640-846d-7f763b6a06bd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:27.980600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ed6ed8c-e484-4640-846d-7f763b6a06bd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:27.988422 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ed6ed8c-e484-4640-846d-7f763b6a06bd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:27.988860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ed6ed8c-e484-4640-846d-7f763b6a06bd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:27.989606 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ed6ed8c-e484-4640-846d-7f763b6a06bd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:27.990028 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ed6ed8c-e484-4640-846d-7f763b6a06bd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:28.160588 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ed6ed8c-e484-4640-846d-7f763b6a06bd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:28.167924 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ed6ed8c-e484-4640-846d-7f763b6a06bd tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1314 microversion: 2.1 time: 0.192689 Jul 27 20:53:28.168524 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1275/2408] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:27 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:29.190564 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7793db09-f047-4735-8e86-1bda6c8f8fd6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:29.191275 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7793db09-f047-4735-8e86-1bda6c8f8fd6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:29.199156 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7793db09-f047-4735-8e86-1bda6c8f8fd6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:29.199643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7793db09-f047-4735-8e86-1bda6c8f8fd6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:29.200436 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7793db09-f047-4735-8e86-1bda6c8f8fd6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:29.200888 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7793db09-f047-4735-8e86-1bda6c8f8fd6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:29.333680 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7793db09-f047-4735-8e86-1bda6c8f8fd6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:29.342595 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7793db09-f047-4735-8e86-1bda6c8f8fd6 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1314 microversion: 2.1 time: 0.157900 Jul 27 20:53:29.343171 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1134/2409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:29 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:53:30.363419 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ddcabf8-071d-48ff-a93a-c6703f17260e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:30.364159 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ddcabf8-071d-48ff-a93a-c6703f17260e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:30.371644 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ddcabf8-071d-48ff-a93a-c6703f17260e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:30.372097 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ddcabf8-071d-48ff-a93a-c6703f17260e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:30.372889 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ddcabf8-071d-48ff-a93a-c6703f17260e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:30.373327 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ddcabf8-071d-48ff-a93a-c6703f17260e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:30.519717 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ddcabf8-071d-48ff-a93a-c6703f17260e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:30.527010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ddcabf8-071d-48ff-a93a-c6703f17260e tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1314 microversion: 2.1 time: 0.167515 Jul 27 20:53:30.527583 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1276/2410] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:30 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:53:31.547739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-43dbada7-b642-4ac5-a8ea-0857f164415c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:31.548322 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-43dbada7-b642-4ac5-a8ea-0857f164415c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:31.554865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43dbada7-b642-4ac5-a8ea-0857f164415c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:31.555311 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43dbada7-b642-4ac5-a8ea-0857f164415c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:31.556058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43dbada7-b642-4ac5-a8ea-0857f164415c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:31.556525 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43dbada7-b642-4ac5-a8ea-0857f164415c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:31.684247 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-43dbada7-b642-4ac5-a8ea-0857f164415c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:31.692024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-43dbada7-b642-4ac5-a8ea-0857f164415c tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1314 microversion: 2.1 time: 0.148224 Jul 27 20:53:31.692621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1135/2411] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:31 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:32.447911 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-7a20339a-7bb6-47f4-a26a-609e9440b0df req-46176fd2-cd64-4660-9dbc-ea8faab8d5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f01bb51-435e-4cbb-9192-02357f5d538e", "name": "network-vif-plugged", "status": "completed", "tag": "85c6d52b-ae0f-41dc-b6a2-79af91a8e5dc"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:32.458617 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-7a20339a-7bb6-47f4-a26a-609e9440b0df req-46176fd2-cd64-4660-9dbc-ea8faab8d5e2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:32.459069 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-7a20339a-7bb6-47f4-a26a-609e9440b0df req-46176fd2-cd64-4660-9dbc-ea8faab8d5e2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:32.470972 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-7a20339a-7bb6-47f4-a26a-609e9440b0df req-46176fd2-cd64-4660-9dbc-ea8faab8d5e2 service nova] Creating event network-vif-plugged:85c6d52b-ae0f-41dc-b6a2-79af91a8e5dc for instance 4f01bb51-435e-4cbb-9192-02357f5d538e on hv-cinder-85124 Jul 27 20:53:32.475933 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-7a20339a-7bb6-47f4-a26a-609e9440b0df req-46176fd2-cd64-4660-9dbc-ea8faab8d5e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032468 Jul 27 20:53:32.476643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1277/2412] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:53:32.713071 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-955ad5a1-e0e7-4a45-b99f-3cd58f2c72ea tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:32.713669 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-955ad5a1-e0e7-4a45-b99f-3cd58f2c72ea tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:32.720966 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-955ad5a1-e0e7-4a45-b99f-3cd58f2c72ea tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:32.721426 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-955ad5a1-e0e7-4a45-b99f-3cd58f2c72ea tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:32.722179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-955ad5a1-e0e7-4a45-b99f-3cd58f2c72ea tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:32.722608 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-955ad5a1-e0e7-4a45-b99f-3cd58f2c72ea tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:32.849986 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-955ad5a1-e0e7-4a45-b99f-3cd58f2c72ea tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:32.857483 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-955ad5a1-e0e7-4a45-b99f-3cd58f2c72ea tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1314 microversion: 2.1 time: 0.148675 Jul 27 20:53:32.858056 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1136/2413] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:32 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:53:33.876590 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:33.877353 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:33.881943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-397b4784-3f79-494f-97c3-1199c4b48cf5 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:33.882609 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-397b4784-3f79-494f-97c3-1199c4b48cf5 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:33.888697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-397b4784-3f79-494f-97c3-1199c4b48cf5 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:33.889144 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-397b4784-3f79-494f-97c3-1199c4b48cf5 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:33.889897 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-397b4784-3f79-494f-97c3-1199c4b48cf5 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:33.890333 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-397b4784-3f79-494f-97c3-1199c4b48cf5 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:34.022235 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-397b4784-3f79-494f-97c3-1199c4b48cf5 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:34.029596 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-397b4784-3f79-494f-97c3-1199c4b48cf5 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1314 microversion: 2.1 time: 0.154596 Jul 27 20:53:34.030179 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1278/2414] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:33 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:35.051183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e152cc32-c989-4e2a-959c-3b8e4ffeab8b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:35.051789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e152cc32-c989-4e2a-959c-3b8e4ffeab8b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:35.053745 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:35.058899 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e152cc32-c989-4e2a-959c-3b8e4ffeab8b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:35.059343 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e152cc32-c989-4e2a-959c-3b8e4ffeab8b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:35.060120 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e152cc32-c989-4e2a-959c-3b8e4ffeab8b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:35.060582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e152cc32-c989-4e2a-959c-3b8e4ffeab8b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:35.198121 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e152cc32-c989-4e2a-959c-3b8e4ffeab8b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:35.205696 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e152cc32-c989-4e2a-959c-3b8e4ffeab8b tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1498 microversion: 2.1 time: 0.158860 Jul 27 20:53:35.206876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1137/2415] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:35 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:36.248052 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d3eeb3e2-b0c6-4c0c-8d2a-8176c097fafa tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:36.248670 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d3eeb3e2-b0c6-4c0c-8d2a-8176c097fafa tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:36.255581 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3eeb3e2-b0c6-4c0c-8d2a-8176c097fafa tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:36.256017 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3eeb3e2-b0c6-4c0c-8d2a-8176c097fafa tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:36.256938 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3eeb3e2-b0c6-4c0c-8d2a-8176c097fafa tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:36.257360 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3eeb3e2-b0c6-4c0c-8d2a-8176c097fafa tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:36.282250 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d3eeb3e2-b0c6-4c0c-8d2a-8176c097fafa tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:53:36.505070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d3eeb3e2-b0c6-4c0c-8d2a-8176c097fafa tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 204 len: 0 microversion: 2.1 time: 0.260486 Jul 27 20:53:36.505674 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1279/2416] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:53:36 2022] DELETE /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:53:36.513662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0dd33836-ac94-4833-af6f-198cb5b5dba3 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:36.514428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0dd33836-ac94-4833-af6f-198cb5b5dba3 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:36.521666 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0dd33836-ac94-4833-af6f-198cb5b5dba3 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:36.522113 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0dd33836-ac94-4833-af6f-198cb5b5dba3 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:36.522865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0dd33836-ac94-4833-af6f-198cb5b5dba3 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:36.523300 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0dd33836-ac94-4833-af6f-198cb5b5dba3 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:36.527183 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=81 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:36.822721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0dd33836-ac94-4833-af6f-198cb5b5dba3 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:36.830217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0dd33836-ac94-4833-af6f-198cb5b5dba3 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1504 microversion: 2.1 time: 0.320341 Jul 27 20:53:36.830789 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1138/2417] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:36 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:37.851525 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f7ba77a1-1b89-4a04-a367-5e9a8f4f23c1 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:37.852141 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f7ba77a1-1b89-4a04-a367-5e9a8f4f23c1 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:37.858927 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7ba77a1-1b89-4a04-a367-5e9a8f4f23c1 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:37.859912 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7ba77a1-1b89-4a04-a367-5e9a8f4f23c1 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:37.860699 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7ba77a1-1b89-4a04-a367-5e9a8f4f23c1 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:37.861135 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f7ba77a1-1b89-4a04-a367-5e9a8f4f23c1 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:38.043540 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f7ba77a1-1b89-4a04-a367-5e9a8f4f23c1 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:38.051589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f7ba77a1-1b89-4a04-a367-5e9a8f4f23c1 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1504 microversion: 2.1 time: 0.204618 Jul 27 20:53:38.052188 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1280/2418] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:37 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:38.660892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-4d6d03af-7b8a-4b15-9c8c-689206e7936e req-e0f89942-4821-422e-b2dc-ffd6f5306468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f01bb51-435e-4cbb-9192-02357f5d538e", "name": "network-vif-deleted", "tag": "85c6d52b-ae0f-41dc-b6a2-79af91a8e5dc"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:38.671551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4d6d03af-7b8a-4b15-9c8c-689206e7936e req-e0f89942-4821-422e-b2dc-ffd6f5306468 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:38.671551 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4d6d03af-7b8a-4b15-9c8c-689206e7936e req-e0f89942-4821-422e-b2dc-ffd6f5306468 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:38.683718 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-4d6d03af-7b8a-4b15-9c8c-689206e7936e req-e0f89942-4821-422e-b2dc-ffd6f5306468 service nova] Creating event network-vif-deleted:85c6d52b-ae0f-41dc-b6a2-79af91a8e5dc for instance 4f01bb51-435e-4cbb-9192-02357f5d538e on hv-cinder-85124 Jul 27 20:53:38.689410 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-4d6d03af-7b8a-4b15-9c8c-689206e7936e req-e0f89942-4821-422e-b2dc-ffd6f5306468 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032466 Jul 27 20:53:38.690067 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1139/2419] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:53:39.072996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:39.073591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:39.079802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:39.080242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:39.081047 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:39.081477 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:39.111891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:39.112356 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:39.112821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lazy-loading 'fault' on Instance uuid 4f01bb51-435e-4cbb-9192-02357f5d538e {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:53:39.155987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffda1c5c6644b98a4b46c45d5e80a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2db90ccbbf468587d34d323c7bcd8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:39.165809 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7cbd341c-8125-4435-b76a-98a73025a300 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 200 len: 1304 microversion: 2.1 time: 0.096416 Jul 27 20:53:39.166700 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1281/2420] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:39 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:40.193405 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:40.194039 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] [instance: 4f01bb51-435e-4cbb-9192-02357f5d538e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:40.200253 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:40.200742 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:40.201498 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:40.201937 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:40.217428 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] HTTP exception thrown: Instance 4f01bb51-435e-4cbb-9192-02357f5d538e could not be found. Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Request method failure captured: Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e HTTP/1.1 Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aWsxC1umVpyZ7SwchNqazJ3owJsM4heBVNHL1abOq5wr5aOffT3-E5R0je29X4UQqL7C3inTV2UJvkifV1XkOujj1P_B6pJ4MA617YAEm3jM80q6HZ0lIKZMlANZzDOEWraonDCCrhgAlTT7TJAPgF79L64GEhRCfiQKkgXVEPiWKg Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: ab2db90ccbbf468587d34d323c7bcd8a Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesActionsTest-1732949642 Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:53:40.219033 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2db90ccbbf468587d34d323c7bcd8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2db90ccbbf468587d34d323c7bcd8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab2db90ccbbf468587d34d323c7bcd8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab2db90ccbbf468587d34d323c7bcd8a", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesActionsTest-1732949642 Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: ab2db90ccbbf468587d34d323c7bcd8a Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesActionsTest-1732949642 Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesActionsTest-1732949642-project Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: bffda1c5c6644b98a4b46c45d5e80a73 Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesActionsTest-1732949642-project Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 4f01bb51-435e-4cbb-9192-02357f5d538e could not be found. Jul 27 20:53:40.221332 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '4f01bb51-435e-4cbb-9192-02357f5d538e'} Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f01bb51-435e-4cbb-9192-02357f5d538e could not be found. Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:53:40.222403 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f01bb51-435e-4cbb-9192-02357f5d538e could not be found. Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f01bb51-435e-4cbb-9192-02357f5d538e could not be found. Jul 27 20:53:40.224301 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:53:40.229424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] Returning 404 to user: Instance 4f01bb51-435e-4cbb-9192-02357f5d538e could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:53:40.229424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-28c9fe24-c084-4044-b390-84aa9e68bbb7 tempest-VolumesActionsTest-1732949642 tempest-VolumesActionsTest-1732949642-project] 10.222.0.47 "GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e" status: 404 len: 111 microversion: 2.1 time: 0.032451 Jul 27 20:53:40.229424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1140/2421] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:40 2022] GET /compute/v2.1/servers/4f01bb51-435e-4cbb-9192-02357f5d538e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:53:44.555515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:53:44.556118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:54:45.652134 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:45.655397 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:45.657071 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-da964231-2f41-42a7-8b1a-a941cb3ce433 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Action: 'create', calling method: .version_select at 0x7f35cec9d940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-322762962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyA/WCh7VlFphLjDVSReDNpaI68oGFTk3K9E0gNlRZegCP01DU81gmoDlljsV+L7/r+uZVbCPDUuRsxVnQeaC7NSM4fJm3ZzgqYskpRKEA8XHML7sUnkqdA4kJBXnFSbw=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:54:45.671869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-da964231-2f41-42a7-8b1a-a941cb3ce433 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Getting quotas for project 155ced356cdb445c904f0eba6a929ebe. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:54:45.678428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-da964231-2f41-42a7-8b1a-a941cb3ce433 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Getting quotas for user 21324556c57e491db51f1a62f08ead79 and project 155ced356cdb445c904f0eba6a929ebe. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:54:45.749031 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-da964231-2f41-42a7-8b1a-a941cb3ce433 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.098814 Jul 27 20:54:45.749816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1282/2422] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 20:54:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:54:45.850496 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=17 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:45.851366 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=9 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:45.855172 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-594355504", "imageRef": "ef5da71a-ba46-48c0-bdda-e9433a74db38", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-322762962", "networks": [{"uuid": "612ab39f-f44b-40d2-8140-601295eef06c"}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:54:45.906906 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] validate_networks() for [('612ab39f-f44b-40d2-8140-601295eef06c', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:54:46.370530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:54:46.370952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:54:46.371427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:54:46.371830 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:54:46.372239 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:54:46.381893 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:46.382338 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:46.383157 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:46.383594 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:46.400278 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Getting quotas for project 155ced356cdb445c904f0eba6a929ebe. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:54:46.404306 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Getting quotas for user 21324556c57e491db51f1a62f08ead79 and project 155ced356cdb445c904f0eba6a929ebe. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:54:46.415006 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:54:46.417188 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef5da71a-ba46-48c0-bdda-e9433a74db38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:54:46.603219 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR oslo.messaging._drivers.impl_rabbit [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [2a75bef6-0b60-4501-876c-d8ddbbdb336b] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 20:54:47.610957 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [2a75bef6-0b60-4501-876c-d8ddbbdb336b] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53842. Jul 27 20:54:47.615018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-63b9abdf-92ab-4c56-8963-0d1d1aceb339 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.766358 Jul 27 20:54:47.615665 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1141/2423] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 20:54:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:54:47.627516 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-879a2622-77f4-44c1-a02a-1c6afe83d261 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:47.628129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-879a2622-77f4-44c1-a02a-1c6afe83d261 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:47.685786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-879a2622-77f4-44c1-a02a-1c6afe83d261 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:47.692458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-879a2622-77f4-44c1-a02a-1c6afe83d261 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1257 microversion: 2.1 time: 0.069929 Jul 27 20:54:47.693242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1283/2424] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:47 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:54:48.713942 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-78e8e1ee-2574-4e71-a73a-bf82ce45b0e3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:48.714555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-78e8e1ee-2574-4e71-a73a-bf82ce45b0e3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:48.768179 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-78e8e1ee-2574-4e71-a73a-bf82ce45b0e3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:48.774928 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-78e8e1ee-2574-4e71-a73a-bf82ce45b0e3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1257 microversion: 2.1 time: 0.065434 Jul 27 20:54:48.775488 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1142/2425] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:48 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:54:49.795996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-928cca0b-12cd-4c92-bd25-ffcd2ec6f678 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:49.796634 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-928cca0b-12cd-4c92-bd25-ffcd2ec6f678 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:49.804684 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-928cca0b-12cd-4c92-bd25-ffcd2ec6f678 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:49.805132 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-928cca0b-12cd-4c92-bd25-ffcd2ec6f678 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:49.805879 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-928cca0b-12cd-4c92-bd25-ffcd2ec6f678 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:49.806309 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-928cca0b-12cd-4c92-bd25-ffcd2ec6f678 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:49.868081 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-928cca0b-12cd-4c92-bd25-ffcd2ec6f678 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:49.876002 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-928cca0b-12cd-4c92-bd25-ffcd2ec6f678 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1309 microversion: 2.1 time: 0.083243 Jul 27 20:54:49.876600 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1284/2426] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:49 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1309 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:54:50.899287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fa57f1b4-68ca-4486-8a6c-851520f53963 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:50.899923 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fa57f1b4-68ca-4486-8a6c-851520f53963 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:50.906821 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa57f1b4-68ca-4486-8a6c-851520f53963 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:50.907276 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa57f1b4-68ca-4486-8a6c-851520f53963 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:50.908053 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa57f1b4-68ca-4486-8a6c-851520f53963 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:50.908530 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa57f1b4-68ca-4486-8a6c-851520f53963 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:51.252214 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fa57f1b4-68ca-4486-8a6c-851520f53963 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:51.266679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fa57f1b4-68ca-4486-8a6c-851520f53963 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.371030 Jul 27 20:54:51.268052 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1143/2427] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:50 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:54:52.210834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-e8841c98-9e76-4ed9-92c9-ae6d94bef05c req-bd65a59b-d9dd-424e-a0d7-275bff34d679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa131d5-2538-4a9b-bf47-28dcfce17068", "tag": "cf524f13-8f20-4148-b736-438d1cbcc5e1"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:54:52.224093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-e8841c98-9e76-4ed9-92c9-ae6d94bef05c req-bd65a59b-d9dd-424e-a0d7-275bff34d679 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:52.224832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-e8841c98-9e76-4ed9-92c9-ae6d94bef05c req-bd65a59b-d9dd-424e-a0d7-275bff34d679 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:52.242786 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-e8841c98-9e76-4ed9-92c9-ae6d94bef05c req-bd65a59b-d9dd-424e-a0d7-275bff34d679 service nova] Creating event network-changed:cf524f13-8f20-4148-b736-438d1cbcc5e1 for instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 on hv-cinder-85124 Jul 27 20:54:52.245776 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-e8841c98-9e76-4ed9-92c9-ae6d94bef05c req-bd65a59b-d9dd-424e-a0d7-275bff34d679 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240257 Jul 27 20:54:52.246790 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1285/2428] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:54:52.293679 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e4640747-bfa7-456f-8202-e6f403ace7ef tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:52.294863 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e4640747-bfa7-456f-8202-e6f403ace7ef tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:52.309713 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4640747-bfa7-456f-8202-e6f403ace7ef tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:52.311065 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4640747-bfa7-456f-8202-e6f403ace7ef tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:52.312369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4640747-bfa7-456f-8202-e6f403ace7ef tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:52.312996 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4640747-bfa7-456f-8202-e6f403ace7ef tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:52.465151 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e4640747-bfa7-456f-8202-e6f403ace7ef tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:52.473512 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e4640747-bfa7-456f-8202-e6f403ace7ef tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.183643 Jul 27 20:54:52.474093 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1144/2429] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:52 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:54:53.496040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8864a3d9-58fb-4b93-bf6d-468abe67cce8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:53.496757 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8864a3d9-58fb-4b93-bf6d-468abe67cce8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:53.503202 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8864a3d9-58fb-4b93-bf6d-468abe67cce8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:53.503848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8864a3d9-58fb-4b93-bf6d-468abe67cce8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:53.504635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8864a3d9-58fb-4b93-bf6d-468abe67cce8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:53.505068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8864a3d9-58fb-4b93-bf6d-468abe67cce8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:53.648276 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8864a3d9-58fb-4b93-bf6d-468abe67cce8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:53.655658 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8864a3d9-58fb-4b93-bf6d-468abe67cce8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.164243 Jul 27 20:54:53.656847 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1286/2430] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:53 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:54:54.677310 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-db6cd9b1-3169-4d94-a6b7-5cc3ef7bcdea tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:54.677839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-db6cd9b1-3169-4d94-a6b7-5cc3ef7bcdea tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:54.684097 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db6cd9b1-3169-4d94-a6b7-5cc3ef7bcdea tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:54.684575 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db6cd9b1-3169-4d94-a6b7-5cc3ef7bcdea tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:54.685348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db6cd9b1-3169-4d94-a6b7-5cc3ef7bcdea tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:54.685771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db6cd9b1-3169-4d94-a6b7-5cc3ef7bcdea tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:54.855431 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-db6cd9b1-3169-4d94-a6b7-5cc3ef7bcdea tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:54.863838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-db6cd9b1-3169-4d94-a6b7-5cc3ef7bcdea tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.190504 Jul 27 20:54:54.864443 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1145/2431] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:54 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:54:55.886402 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2934ffa3-c363-4331-b6ec-e71be2434e0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:55.887160 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2934ffa3-c363-4331-b6ec-e71be2434e0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:55.897905 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2934ffa3-c363-4331-b6ec-e71be2434e0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:55.898504 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2934ffa3-c363-4331-b6ec-e71be2434e0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:55.899400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2934ffa3-c363-4331-b6ec-e71be2434e0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:55.900062 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2934ffa3-c363-4331-b6ec-e71be2434e0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:56.058056 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2934ffa3-c363-4331-b6ec-e71be2434e0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:56.065988 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2934ffa3-c363-4331-b6ec-e71be2434e0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.184016 Jul 27 20:54:56.066579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1287/2432] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:55 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:54:57.087818 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1c24072f-1705-4111-8253-309447dacf75 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:57.088544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1c24072f-1705-4111-8253-309447dacf75 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:57.090800 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:57.095824 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c24072f-1705-4111-8253-309447dacf75 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:57.096318 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c24072f-1705-4111-8253-309447dacf75 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:57.097118 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c24072f-1705-4111-8253-309447dacf75 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:57.097555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c24072f-1705-4111-8253-309447dacf75 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:57.238121 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1c24072f-1705-4111-8253-309447dacf75 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:57.245922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1c24072f-1705-4111-8253-309447dacf75 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.161973 Jul 27 20:54:57.246489 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1146/2433] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:57 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:54:58.267920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd417fac-7ecf-4b09-ab9b-a7d26e21ffd8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:58.268718 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fd417fac-7ecf-4b09-ab9b-a7d26e21ffd8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:58.272188 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:58.275846 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd417fac-7ecf-4b09-ab9b-a7d26e21ffd8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:58.276642 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd417fac-7ecf-4b09-ab9b-a7d26e21ffd8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:58.278421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd417fac-7ecf-4b09-ab9b-a7d26e21ffd8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:58.278921 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd417fac-7ecf-4b09-ab9b-a7d26e21ffd8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:58.417926 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd417fac-7ecf-4b09-ab9b-a7d26e21ffd8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:58.426161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd417fac-7ecf-4b09-ab9b-a7d26e21ffd8 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.162688 Jul 27 20:54:58.429283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1288/2434] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:58 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:54:59.447263 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-544c536f-a02f-4c1b-a603-a44f54637908 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:59.447807 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-544c536f-a02f-4c1b-a603-a44f54637908 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:59.450107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=8 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:59.455691 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-544c536f-a02f-4c1b-a603-a44f54637908 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:59.456148 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-544c536f-a02f-4c1b-a603-a44f54637908 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:59.456952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-544c536f-a02f-4c1b-a603-a44f54637908 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:59.457388 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-544c536f-a02f-4c1b-a603-a44f54637908 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:59.585591 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-544c536f-a02f-4c1b-a603-a44f54637908 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:59.593019 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-544c536f-a02f-4c1b-a603-a44f54637908 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.149729 Jul 27 20:54:59.593587 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1147/2435] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:59 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:00.614784 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5b7a4c50-c8f7-4bdc-9999-19f6da94f176 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:00.615421 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5b7a4c50-c8f7-4bdc-9999-19f6da94f176 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:00.621821 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b7a4c50-c8f7-4bdc-9999-19f6da94f176 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:00.622259 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b7a4c50-c8f7-4bdc-9999-19f6da94f176 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:00.623000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b7a4c50-c8f7-4bdc-9999-19f6da94f176 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:00.623427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b7a4c50-c8f7-4bdc-9999-19f6da94f176 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:00.749079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5b7a4c50-c8f7-4bdc-9999-19f6da94f176 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:00.756313 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5b7a4c50-c8f7-4bdc-9999-19f6da94f176 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.145406 Jul 27 20:55:00.756899 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1289/2436] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:00 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:01.776634 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9537a5ad-730e-477f-a920-bb66289bddff tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:01.777237 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9537a5ad-730e-477f-a920-bb66289bddff tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:01.784283 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9537a5ad-730e-477f-a920-bb66289bddff tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:01.784747 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9537a5ad-730e-477f-a920-bb66289bddff tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:01.785484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9537a5ad-730e-477f-a920-bb66289bddff tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:01.785909 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9537a5ad-730e-477f-a920-bb66289bddff tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:01.915154 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9537a5ad-730e-477f-a920-bb66289bddff tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:01.922637 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9537a5ad-730e-477f-a920-bb66289bddff tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.149910 Jul 27 20:55:01.923197 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1148/2437] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:01 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:02.943574 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-49f6aaa2-8308-471b-b6c2-b414fbb99257 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:02.944182 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49f6aaa2-8308-471b-b6c2-b414fbb99257 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:02.950591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49f6aaa2-8308-471b-b6c2-b414fbb99257 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:02.951040 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49f6aaa2-8308-471b-b6c2-b414fbb99257 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:02.951798 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49f6aaa2-8308-471b-b6c2-b414fbb99257 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:02.952312 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49f6aaa2-8308-471b-b6c2-b414fbb99257 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:03.085384 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49f6aaa2-8308-471b-b6c2-b414fbb99257 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:03.091740 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-49f6aaa2-8308-471b-b6c2-b414fbb99257 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.151978 Jul 27 20:55:03.092311 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1290/2438] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:02 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:04.112018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7e6bfb2f-ecda-4b24-b1de-a0c626ca97af tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:04.112692 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7e6bfb2f-ecda-4b24-b1de-a0c626ca97af tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:04.119211 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e6bfb2f-ecda-4b24-b1de-a0c626ca97af tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:04.119701 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e6bfb2f-ecda-4b24-b1de-a0c626ca97af tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:04.120484 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e6bfb2f-ecda-4b24-b1de-a0c626ca97af tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:04.120926 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e6bfb2f-ecda-4b24-b1de-a0c626ca97af tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:04.251891 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7e6bfb2f-ecda-4b24-b1de-a0c626ca97af tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:04.259430 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7e6bfb2f-ecda-4b24-b1de-a0c626ca97af tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.151230 Jul 27 20:55:04.260004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1149/2439] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:04 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:55:05.117470 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-9257a6b0-6ef1-4b76-94a0-499b019ef3bd req-1a22de9a-0fed-4f57-8f50-3b0c1b6641c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa131d5-2538-4a9b-bf47-28dcfce17068", "name": "network-vif-plugged", "status": "completed", "tag": "cf524f13-8f20-4148-b736-438d1cbcc5e1"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:55:05.127712 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-9257a6b0-6ef1-4b76-94a0-499b019ef3bd req-1a22de9a-0fed-4f57-8f50-3b0c1b6641c9 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:05.128147 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-9257a6b0-6ef1-4b76-94a0-499b019ef3bd req-1a22de9a-0fed-4f57-8f50-3b0c1b6641c9 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:05.138505 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-9257a6b0-6ef1-4b76-94a0-499b019ef3bd req-1a22de9a-0fed-4f57-8f50-3b0c1b6641c9 service nova] Creating event network-vif-plugged:cf524f13-8f20-4148-b736-438d1cbcc5e1 for instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 on hv-cinder-85124 Jul 27 20:55:05.144436 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-9257a6b0-6ef1-4b76-94a0-499b019ef3bd req-1a22de9a-0fed-4f57-8f50-3b0c1b6641c9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085703 Jul 27 20:55:05.145010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1291/2440] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:55:05.279992 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3e7a1661-6a98-4562-84c1-c53a9560adcf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:05.280623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3e7a1661-6a98-4562-84c1-c53a9560adcf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:05.287864 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e7a1661-6a98-4562-84c1-c53a9560adcf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:05.292285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e7a1661-6a98-4562-84c1-c53a9560adcf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:05.292285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e7a1661-6a98-4562-84c1-c53a9560adcf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:05.292285 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e7a1661-6a98-4562-84c1-c53a9560adcf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:05.420694 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3e7a1661-6a98-4562-84c1-c53a9560adcf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:05.428682 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3e7a1661-6a98-4562-84c1-c53a9560adcf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.152435 Jul 27 20:55:05.429952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1150/2441] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:05 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:06.451298 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-923b4a6f-1c89-4c06-a500-fe0421b133c0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:06.451999 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-923b4a6f-1c89-4c06-a500-fe0421b133c0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:06.458206 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-923b4a6f-1c89-4c06-a500-fe0421b133c0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:06.461851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-923b4a6f-1c89-4c06-a500-fe0421b133c0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:06.461851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-923b4a6f-1c89-4c06-a500-fe0421b133c0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:06.461851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-923b4a6f-1c89-4c06-a500-fe0421b133c0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:06.588156 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-923b4a6f-1c89-4c06-a500-fe0421b133c0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:06.595982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-923b4a6f-1c89-4c06-a500-fe0421b133c0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1357 microversion: 2.1 time: 0.149382 Jul 27 20:55:06.596510 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1292/2442] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:06 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:07.616235 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-58e96ee2-aad4-43a3-8f69-387702bb41cf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:07.616811 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-58e96ee2-aad4-43a3-8f69-387702bb41cf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:07.623482 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58e96ee2-aad4-43a3-8f69-387702bb41cf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:07.623929 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58e96ee2-aad4-43a3-8f69-387702bb41cf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:07.624781 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58e96ee2-aad4-43a3-8f69-387702bb41cf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:07.625768 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58e96ee2-aad4-43a3-8f69-387702bb41cf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:07.756531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-58e96ee2-aad4-43a3-8f69-387702bb41cf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:07.763876 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-58e96ee2-aad4-43a3-8f69-387702bb41cf tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1547 microversion: 2.1 time: 0.151544 Jul 27 20:55:07.764463 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1151/2443] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:07 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:07.783766 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-43eee055-25e6-473c-924f-4bd4b4d48036 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:07.784428 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-43eee055-25e6-473c-924f-4bd4b4d48036 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:07.790917 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43eee055-25e6-473c-924f-4bd4b4d48036 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:07.791364 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43eee055-25e6-473c-924f-4bd4b4d48036 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:07.792119 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43eee055-25e6-473c-924f-4bd4b4d48036 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:07.792589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43eee055-25e6-473c-924f-4bd4b4d48036 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:07.920837 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-43eee055-25e6-473c-924f-4bd4b4d48036 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:07.928985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-43eee055-25e6-473c-924f-4bd4b4d48036 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1547 microversion: 2.1 time: 0.149069 Jul 27 20:55:07.929563 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1293/2444] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:07 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:07.949035 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-84eeba80-9611-4084-8547-f4643171ed03 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:07.953723 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-84eeba80-9611-4084-8547-f4643171ed03 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:07.954491 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-84eeba80-9611-4084-8547-f4643171ed03 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Searching by: {'deleted': False, 'project_id': '155ced356cdb445c904f0eba6a929ebe'} {{(pid=118273) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 27 20:55:07.961058 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84eeba80-9611-4084-8547-f4643171ed03 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:07.961509 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84eeba80-9611-4084-8547-f4643171ed03 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:07.962299 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84eeba80-9611-4084-8547-f4643171ed03 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:07.962739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-84eeba80-9611-4084-8547-f4643171ed03 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:08.051795 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.multi_cell_list [None req-84eeba80-9611-4084-8547-f4643171ed03 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118273) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 27 20:55:08.145941 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-84eeba80-9611-4084-8547-f4643171ed03 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200633 Jul 27 20:55:08.146443 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1152/2445] 10.222.0.47 () {58 vars in 1125 bytes} [Wed Jul 27 20:55:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:55:08.158073 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6b41fcb2-05fe-48ac-a732-75c72083bd0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:08.158711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6b41fcb2-05fe-48ac-a732-75c72083bd0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:08.164690 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b41fcb2-05fe-48ac-a732-75c72083bd0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:08.165136 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b41fcb2-05fe-48ac-a732-75c72083bd0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:08.165878 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b41fcb2-05fe-48ac-a732-75c72083bd0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:08.166307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b41fcb2-05fe-48ac-a732-75c72083bd0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:08.292223 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6b41fcb2-05fe-48ac-a732-75c72083bd0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:08.300093 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6b41fcb2-05fe-48ac-a732-75c72083bd0c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1547 microversion: 2.1 time: 0.146430 Jul 27 20:55:08.300694 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1294/2446] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:08 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:10.191337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5091339f-41fd-4aa4-ac23-701e9f980e04 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8a94d50-e3f4-4a04-aa37-b01280881f69"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:55:10.193739 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5091339f-41fd-4aa4-ac23-701e9f980e04 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:10.200258 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5091339f-41fd-4aa4-ac23-701e9f980e04 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:10.200734 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5091339f-41fd-4aa4-ac23-701e9f980e04 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:10.201494 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5091339f-41fd-4aa4-ac23-701e9f980e04 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:10.201917 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5091339f-41fd-4aa4-ac23-701e9f980e04 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:10.916873 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5091339f-41fd-4aa4-ac23-701e9f980e04 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "POST /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729722 Jul 27 20:55:10.917561 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1153/2447] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 20:55:10 2022] POST /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:55:18.487133 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8ccbc590-39c3-496a-9f78-1c581f374e4d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:18.487871 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8ccbc590-39c3-496a-9f78-1c581f374e4d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:18.490283 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:18.491036 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=58 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:18.495831 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ccbc590-39c3-496a-9f78-1c581f374e4d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:18.496348 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ccbc590-39c3-496a-9f78-1c581f374e4d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:18.497227 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ccbc590-39c3-496a-9f78-1c581f374e4d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:18.497748 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ccbc590-39c3-496a-9f78-1c581f374e4d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:18.627943 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ccbc590-39c3-496a-9f78-1c581f374e4d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:18.635816 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8ccbc590-39c3-496a-9f78-1c581f374e4d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1593 microversion: 2.1 time: 0.153312 Jul 27 20:55:18.636397 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1295/2448] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:18 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1593 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:20.914555 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-487e5691-bc0b-4178-8be2-8baf2e130056 req-75c256c9-eabd-4631-a15c-2ef5836083b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa131d5-2538-4a9b-bf47-28dcfce17068", "tag": "cf524f13-8f20-4148-b736-438d1cbcc5e1"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:55:20.920227 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:20.921098 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:20.921847 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:20.927623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-487e5691-bc0b-4178-8be2-8baf2e130056 req-75c256c9-eabd-4631-a15c-2ef5836083b0 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:20.928173 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-487e5691-bc0b-4178-8be2-8baf2e130056 req-75c256c9-eabd-4631-a15c-2ef5836083b0 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:20.943024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-487e5691-bc0b-4178-8be2-8baf2e130056 req-75c256c9-eabd-4631-a15c-2ef5836083b0 service nova] Creating event network-changed:cf524f13-8f20-4148-b736-438d1cbcc5e1 for instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 on hv-cinder-85124 Jul 27 20:55:20.945377 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-487e5691-bc0b-4178-8be2-8baf2e130056 req-75c256c9-eabd-4631-a15c-2ef5836083b0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035318 Jul 27 20:55:20.946026 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1154/2449] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:55:23.174415 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-83b80197-f55d-4543-9ba8-36932ef5da16 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1532281566"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:55:23.174942 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-83b80197-f55d-4543-9ba8-36932ef5da16 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:23.181326 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83b80197-f55d-4543-9ba8-36932ef5da16 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:23.181774 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83b80197-f55d-4543-9ba8-36932ef5da16 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:23.182526 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83b80197-f55d-4543-9ba8-36932ef5da16 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:23.182957 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83b80197-f55d-4543-9ba8-36932ef5da16 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:23.311219 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.network.security_group_api [None req-83b80197-f55d-4543-9ba8-36932ef5da16 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Adding security group 804922c9-73eb-4a97-a598-b0c1d4a96b11 to port cf524f13-8f20-4148-b736-438d1cbcc5e1 Jul 27 20:55:23.749329 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-83b80197-f55d-4543-9ba8-36932ef5da16 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "POST /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/action" status: 202 len: 0 microversion: 2.1 time: 0.577753 Jul 27 20:55:23.754400 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1296/2450] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:55:23 2022] POST /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:55:23.763951 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-c5f297eb-8890-4e3c-a846-590addffe178 req-18b4fc5a-13c7-4532-9223-2bea902bda25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa131d5-2538-4a9b-bf47-28dcfce17068", "tag": "cf524f13-8f20-4148-b736-438d1cbcc5e1"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:55:23.769560 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1ebc5015-26f6-4120-a9f5-f5ec8f4daece tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:23.770337 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1ebc5015-26f6-4120-a9f5-f5ec8f4daece tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:23.778828 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-c5f297eb-8890-4e3c-a846-590addffe178 req-18b4fc5a-13c7-4532-9223-2bea902bda25 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:23.781119 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-c5f297eb-8890-4e3c-a846-590addffe178 req-18b4fc5a-13c7-4532-9223-2bea902bda25 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:23.783836 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1ebc5015-26f6-4120-a9f5-f5ec8f4daece tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:23.784164 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1ebc5015-26f6-4120-a9f5-f5ec8f4daece tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:23.784973 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1ebc5015-26f6-4120-a9f5-f5ec8f4daece tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:23.785408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1ebc5015-26f6-4120-a9f5-f5ec8f4daece tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:23.800242 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-c5f297eb-8890-4e3c-a846-590addffe178 req-18b4fc5a-13c7-4532-9223-2bea902bda25 service nova] Creating event network-changed:cf524f13-8f20-4148-b736-438d1cbcc5e1 for instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 on hv-cinder-85124 Jul 27 20:55:23.806340 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-c5f297eb-8890-4e3c-a846-590addffe178 req-18b4fc5a-13c7-4532-9223-2bea902bda25 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045763 Jul 27 20:55:23.809909 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1297/2451] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:55:24.069413 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1ebc5015-26f6-4120-a9f5-f5ec8f4daece tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:24.078615 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1ebc5015-26f6-4120-a9f5-f5ec8f4daece tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1759 microversion: 2.1 time: 0.323338 Jul 27 20:55:24.079209 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1155/2452] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:23 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1759 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:46.764163 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:46.765614 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=12 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:46.769777 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-26cc5ab6-29b2-485f-b8b8-14484ed7b166 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:55:46.772169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-26cc5ab6-29b2-485f-b8b8-14484ed7b166 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:46.778979 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26cc5ab6-29b2-485f-b8b8-14484ed7b166 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:46.779427 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26cc5ab6-29b2-485f-b8b8-14484ed7b166 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:46.780181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26cc5ab6-29b2-485f-b8b8-14484ed7b166 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:46.780645 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26cc5ab6-29b2-485f-b8b8-14484ed7b166 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:46.982929 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-26cc5ab6-29b2-485f-b8b8-14484ed7b166 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "POST /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/action" status: 202 len: 0 microversion: 2.1 time: 0.219950 Jul 27 20:55:46.983750 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1298/2453] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:55:46 2022] POST /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:55:46.992001 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ed192708-89db-452c-8e7d-899596757517 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:46.992544 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ed192708-89db-452c-8e7d-899596757517 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:46.994582 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:46.995234 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=8 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:47.000054 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed192708-89db-452c-8e7d-899596757517 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:47.002904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed192708-89db-452c-8e7d-899596757517 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:47.002904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed192708-89db-452c-8e7d-899596757517 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:47.002904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed192708-89db-452c-8e7d-899596757517 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:47.175834 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ed192708-89db-452c-8e7d-899596757517 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:47.184401 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ed192708-89db-452c-8e7d-899596757517 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1751 microversion: 2.1 time: 0.196640 Jul 27 20:55:47.185018 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1156/2454] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:46 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:48.207070 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b368e985-b9a6-45d0-b5f7-a6cad1fed8fc tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:48.207770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b368e985-b9a6-45d0-b5f7-a6cad1fed8fc tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:48.214532 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b368e985-b9a6-45d0-b5f7-a6cad1fed8fc tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:48.214982 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b368e985-b9a6-45d0-b5f7-a6cad1fed8fc tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:48.215737 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b368e985-b9a6-45d0-b5f7-a6cad1fed8fc tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:48.216169 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b368e985-b9a6-45d0-b5f7-a6cad1fed8fc tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:48.357580 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b368e985-b9a6-45d0-b5f7-a6cad1fed8fc tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:48.365539 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b368e985-b9a6-45d0-b5f7-a6cad1fed8fc tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.163153 Jul 27 20:55:48.366105 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1299/2455] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:48 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:49.388731 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a8e23ebb-3a1c-4dff-a415-e411fc2a4a36 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:49.389468 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a8e23ebb-3a1c-4dff-a415-e411fc2a4a36 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:49.395995 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8e23ebb-3a1c-4dff-a415-e411fc2a4a36 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:49.396474 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8e23ebb-3a1c-4dff-a415-e411fc2a4a36 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:49.397240 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8e23ebb-3a1c-4dff-a415-e411fc2a4a36 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:49.397677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8e23ebb-3a1c-4dff-a415-e411fc2a4a36 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:49.543838 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a8e23ebb-3a1c-4dff-a415-e411fc2a4a36 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:49.551693 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a8e23ebb-3a1c-4dff-a415-e411fc2a4a36 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.168782 Jul 27 20:55:49.552254 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1157/2456] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:49 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:50.573032 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2c59b9a3-ef9f-4db7-bf0a-587cfff07453 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:50.573637 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2c59b9a3-ef9f-4db7-bf0a-587cfff07453 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:50.580220 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c59b9a3-ef9f-4db7-bf0a-587cfff07453 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:50.580697 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c59b9a3-ef9f-4db7-bf0a-587cfff07453 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:50.581458 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c59b9a3-ef9f-4db7-bf0a-587cfff07453 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:50.581891 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c59b9a3-ef9f-4db7-bf0a-587cfff07453 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:50.720300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2c59b9a3-ef9f-4db7-bf0a-587cfff07453 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:50.728996 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2c59b9a3-ef9f-4db7-bf0a-587cfff07453 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.159869 Jul 27 20:55:50.729576 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1300/2457] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:50 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:51.751007 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-240a3b6c-ee87-42ad-8cd9-2c4ee91ca184 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:51.751614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-240a3b6c-ee87-42ad-8cd9-2c4ee91ca184 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:51.758903 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-240a3b6c-ee87-42ad-8cd9-2c4ee91ca184 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:51.759353 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-240a3b6c-ee87-42ad-8cd9-2c4ee91ca184 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:51.760146 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-240a3b6c-ee87-42ad-8cd9-2c4ee91ca184 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:51.760621 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-240a3b6c-ee87-42ad-8cd9-2c4ee91ca184 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:51.910453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-240a3b6c-ee87-42ad-8cd9-2c4ee91ca184 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:51.916990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-240a3b6c-ee87-42ad-8cd9-2c4ee91ca184 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.169869 Jul 27 20:55:51.917761 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1158/2458] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:51 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:52.938641 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-83651609-0d8a-4efe-91b8-2fd65fb6fc97 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:52.939266 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-83651609-0d8a-4efe-91b8-2fd65fb6fc97 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:52.946161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83651609-0d8a-4efe-91b8-2fd65fb6fc97 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:52.946607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83651609-0d8a-4efe-91b8-2fd65fb6fc97 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:52.947359 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83651609-0d8a-4efe-91b8-2fd65fb6fc97 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:52.947795 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83651609-0d8a-4efe-91b8-2fd65fb6fc97 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:53.092731 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-83651609-0d8a-4efe-91b8-2fd65fb6fc97 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:53.100779 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-83651609-0d8a-4efe-91b8-2fd65fb6fc97 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.166031 Jul 27 20:55:53.101343 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1301/2459] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:52 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:54.122207 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e8829f0d-2783-41b3-9cb4-00941ac11989 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:54.122865 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e8829f0d-2783-41b3-9cb4-00941ac11989 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:54.129386 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8829f0d-2783-41b3-9cb4-00941ac11989 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:54.129831 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8829f0d-2783-41b3-9cb4-00941ac11989 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:54.130614 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8829f0d-2783-41b3-9cb4-00941ac11989 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:54.131046 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8829f0d-2783-41b3-9cb4-00941ac11989 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:54.272160 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e8829f0d-2783-41b3-9cb4-00941ac11989 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:54.280249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e8829f0d-2783-41b3-9cb4-00941ac11989 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.161905 Jul 27 20:55:54.280839 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1159/2460] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:54 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:55.302010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a6ce6608-3e58-4b78-8032-683c574bc7f0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:55.302546 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a6ce6608-3e58-4b78-8032-683c574bc7f0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:55.308987 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6ce6608-3e58-4b78-8032-683c574bc7f0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:55.309437 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6ce6608-3e58-4b78-8032-683c574bc7f0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:55.310185 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6ce6608-3e58-4b78-8032-683c574bc7f0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:55.310616 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a6ce6608-3e58-4b78-8032-683c574bc7f0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:55.456621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a6ce6608-3e58-4b78-8032-683c574bc7f0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:55.464734 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a6ce6608-3e58-4b78-8032-683c574bc7f0 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.166638 Jul 27 20:55:55.465307 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1302/2461] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:55 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:56.486356 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-994eb443-65fc-4d84-be17-e35eb4adb97a tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:56.487004 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-994eb443-65fc-4d84-be17-e35eb4adb97a tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:56.494305 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-994eb443-65fc-4d84-be17-e35eb4adb97a tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:56.494754 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-994eb443-65fc-4d84-be17-e35eb4adb97a tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:56.495520 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-994eb443-65fc-4d84-be17-e35eb4adb97a tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:56.495952 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-994eb443-65fc-4d84-be17-e35eb4adb97a tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:56.637422 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-994eb443-65fc-4d84-be17-e35eb4adb97a tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:56.645201 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-994eb443-65fc-4d84-be17-e35eb4adb97a tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.162746 Jul 27 20:55:56.645771 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1160/2462] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:56 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:57.666357 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f6b056c9-eff0-4f2a-8fb2-4db9eb5df112 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:57.666866 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f6b056c9-eff0-4f2a-8fb2-4db9eb5df112 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:57.673420 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6b056c9-eff0-4f2a-8fb2-4db9eb5df112 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:57.673857 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6b056c9-eff0-4f2a-8fb2-4db9eb5df112 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:57.674591 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6b056c9-eff0-4f2a-8fb2-4db9eb5df112 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:57.675012 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f6b056c9-eff0-4f2a-8fb2-4db9eb5df112 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:57.817171 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f6b056c9-eff0-4f2a-8fb2-4db9eb5df112 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:57.825631 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f6b056c9-eff0-4f2a-8fb2-4db9eb5df112 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.163248 Jul 27 20:55:57.826189 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1303/2463] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:57 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:58.846881 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7c65b951-eb52-47b7-8894-2bf618195e3f tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:58.847515 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7c65b951-eb52-47b7-8894-2bf618195e3f tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:58.854228 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c65b951-eb52-47b7-8894-2bf618195e3f tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:58.854677 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c65b951-eb52-47b7-8894-2bf618195e3f tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:58.855442 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c65b951-eb52-47b7-8894-2bf618195e3f tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:58.856127 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7c65b951-eb52-47b7-8894-2bf618195e3f tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:58.995064 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7c65b951-eb52-47b7-8894-2bf618195e3f tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:59.003241 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7c65b951-eb52-47b7-8894-2bf618195e3f tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.160264 Jul 27 20:55:59.003811 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1161/2464] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:58 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:56:00.024958 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c2136fe2-a06e-42d3-b86f-d7c2838e71f2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:00.025567 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c2136fe2-a06e-42d3-b86f-d7c2838e71f2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:00.032000 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c2136fe2-a06e-42d3-b86f-d7c2838e71f2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:00.032491 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c2136fe2-a06e-42d3-b86f-d7c2838e71f2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:00.033249 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c2136fe2-a06e-42d3-b86f-d7c2838e71f2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:00.033683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c2136fe2-a06e-42d3-b86f-d7c2838e71f2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:00.172589 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c2136fe2-a06e-42d3-b86f-d7c2838e71f2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:56:00.180621 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c2136fe2-a06e-42d3-b86f-d7c2838e71f2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.160013 Jul 27 20:56:00.181205 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1304/2465] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:00 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:56:01.202721 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-70b23c53-46f3-4deb-a377-1f264c70eee2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:01.203369 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-70b23c53-46f3-4deb-a377-1f264c70eee2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:01.209897 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70b23c53-46f3-4deb-a377-1f264c70eee2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:01.210348 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70b23c53-46f3-4deb-a377-1f264c70eee2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:01.211103 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70b23c53-46f3-4deb-a377-1f264c70eee2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:01.211537 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-70b23c53-46f3-4deb-a377-1f264c70eee2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:01.356111 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-70b23c53-46f3-4deb-a377-1f264c70eee2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:56:01.364121 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-70b23c53-46f3-4deb-a377-1f264c70eee2 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.165252 Jul 27 20:56:01.364794 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1162/2466] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:01 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:56:02.385472 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7826d0d4-6291-48d3-a94c-0f152f11226d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:02.386079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7826d0d4-6291-48d3-a94c-0f152f11226d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:02.392557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7826d0d4-6291-48d3-a94c-0f152f11226d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:02.393010 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7826d0d4-6291-48d3-a94c-0f152f11226d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:02.393763 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7826d0d4-6291-48d3-a94c-0f152f11226d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:02.394199 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7826d0d4-6291-48d3-a94c-0f152f11226d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:02.531620 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7826d0d4-6291-48d3-a94c-0f152f11226d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:56:02.539876 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7826d0d4-6291-48d3-a94c-0f152f11226d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.158957 Jul 27 20:56:02.540452 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1305/2467] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:02 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:56:03.561150 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-252abb87-778b-4b11-8fe2-cde558f48f02 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:03.561764 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-252abb87-778b-4b11-8fe2-cde558f48f02 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:03.568255 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-252abb87-778b-4b11-8fe2-cde558f48f02 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:03.568737 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-252abb87-778b-4b11-8fe2-cde558f48f02 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:03.570107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-252abb87-778b-4b11-8fe2-cde558f48f02 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:03.570553 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-252abb87-778b-4b11-8fe2-cde558f48f02 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:03.721757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-252abb87-778b-4b11-8fe2-cde558f48f02 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:56:03.721757 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-252abb87-778b-4b11-8fe2-cde558f48f02 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1756 microversion: 2.1 time: 0.164376 Jul 27 20:56:03.722333 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1163/2468] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:03 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:56:04.743511 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-daf34e10-831a-4369-857c-6b43ca9e194e tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:04.747011 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-daf34e10-831a-4369-857c-6b43ca9e194e tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:04.750635 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-daf34e10-831a-4369-857c-6b43ca9e194e tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:04.751115 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-daf34e10-831a-4369-857c-6b43ca9e194e tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:04.751869 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-daf34e10-831a-4369-857c-6b43ca9e194e tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:04.752301 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-daf34e10-831a-4369-857c-6b43ca9e194e tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:04.904860 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-daf34e10-831a-4369-857c-6b43ca9e194e tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:56:04.912719 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-daf34e10-831a-4369-857c-6b43ca9e194e tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1759 microversion: 2.1 time: 0.173148 Jul 27 20:56:04.913300 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1306/2469] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:04 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:56:38.001510 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e3e82ac2-5836-45ec-8270-eb7a8fc1fdb3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1532281566"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:56:38.002140 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e3e82ac2-5836-45ec-8270-eb7a8fc1fdb3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:38.004056 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=16 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:56:38.004748 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=48 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:56:38.009990 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3e82ac2-5836-45ec-8270-eb7a8fc1fdb3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:38.010443 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3e82ac2-5836-45ec-8270-eb7a8fc1fdb3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:38.011203 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3e82ac2-5836-45ec-8270-eb7a8fc1fdb3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:38.011643 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3e82ac2-5836-45ec-8270-eb7a8fc1fdb3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:38.139735 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.network.security_group_api [None req-e3e82ac2-5836-45ec-8270-eb7a8fc1fdb3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Removing security group 804922c9-73eb-4a97-a598-b0c1d4a96b11 from port cf524f13-8f20-4148-b736-438d1cbcc5e1 Jul 27 20:56:38.512208 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e3e82ac2-5836-45ec-8270-eb7a8fc1fdb3 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "POST /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/action" status: 202 len: 0 microversion: 2.1 time: 0.514701 Jul 27 20:56:38.515163 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1164/2470] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 20:56:37 2022] POST /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:56:38.519020 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-755c1697-07cb-4bc3-bf51-878f27579588 req-b77b7d21-ecd0-4b4c-a7eb-d87a22616df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa131d5-2538-4a9b-bf47-28dcfce17068", "tag": "cf524f13-8f20-4148-b736-438d1cbcc5e1"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:56:38.533068 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=18 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:56:38.534990 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:56:38.537493 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-755c1697-07cb-4bc3-bf51-878f27579588 req-b77b7d21-ecd0-4b4c-a7eb-d87a22616df2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:38.537934 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-755c1697-07cb-4bc3-bf51-878f27579588 req-b77b7d21-ecd0-4b4c-a7eb-d87a22616df2 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:38.554006 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-755c1697-07cb-4bc3-bf51-878f27579588 req-b77b7d21-ecd0-4b4c-a7eb-d87a22616df2 service nova] Creating event network-changed:cf524f13-8f20-4148-b736-438d1cbcc5e1 for instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 on hv-cinder-85124 Jul 27 20:56:38.562150 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-755c1697-07cb-4bc3-bf51-878f27579588 req-b77b7d21-ecd0-4b4c-a7eb-d87a22616df2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046584 Jul 27 20:56:38.563433 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1307/2471] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:56:40.194334 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f0920c4c-0ea3-470e-85d4-5d4feb9c9c87 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:40.194817 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f0920c4c-0ea3-470e-85d4-5d4feb9c9c87 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:40.200904 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0920c4c-0ea3-470e-85d4-5d4feb9c9c87 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:40.201351 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0920c4c-0ea3-470e-85d4-5d4feb9c9c87 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:40.202099 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0920c4c-0ea3-470e-85d4-5d4feb9c9c87 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:40.202531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0920c4c-0ea3-470e-85d4-5d4feb9c9c87 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:40.284158 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-f0920c4c-0ea3-470e-85d4-5d4feb9c9c87 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lazy-loading 'services' on Instance uuid 8fa131d5-2538-4a9b-bf47-28dcfce17068 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:56:40.503675 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f0920c4c-0ea3-470e-85d4-5d4feb9c9c87 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments/c8a94d50-e3f4-4a04-aa37-b01280881f69" status: 202 len: 0 microversion: 2.1 time: 0.314514 Jul 27 20:56:40.504295 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1165/2472] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:56:40 2022] DELETE /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments/c8a94d50-e3f4-4a04-aa37-b01280881f69 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:56:40.515282 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7c4a0abc-41b5-4116-86d1-2714c74734ad tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:40.517557 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7c4a0abc-41b5-4116-86d1-2714c74734ad tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:40.525711 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c4a0abc-41b5-4116-86d1-2714c74734ad tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:40.529467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c4a0abc-41b5-4116-86d1-2714c74734ad tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:40.529467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c4a0abc-41b5-4116-86d1-2714c74734ad tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:40.529467 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c4a0abc-41b5-4116-86d1-2714c74734ad tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:40.557922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7c4a0abc-41b5-4116-86d1-2714c74734ad tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047110 Jul 27 20:56:40.557922 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1308/2473] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:56:40 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:56:40.577940 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-db3da790-3ce9-4cd3-ba69-985843836a99 req-077620a5-6889-4c4e-91dc-0cabeaa7d6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa131d5-2538-4a9b-bf47-28dcfce17068", "tag": "cf524f13-8f20-4148-b736-438d1cbcc5e1"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:56:40.587784 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-db3da790-3ce9-4cd3-ba69-985843836a99 req-077620a5-6889-4c4e-91dc-0cabeaa7d6bd service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:40.588218 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-db3da790-3ce9-4cd3-ba69-985843836a99 req-077620a5-6889-4c4e-91dc-0cabeaa7d6bd service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:40.599374 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-db3da790-3ce9-4cd3-ba69-985843836a99 req-077620a5-6889-4c4e-91dc-0cabeaa7d6bd service nova] Creating event network-changed:cf524f13-8f20-4148-b736-438d1cbcc5e1 for instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 on hv-cinder-85124 Jul 27 20:56:40.604434 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-db3da790-3ce9-4cd3-ba69-985843836a99 req-077620a5-6889-4c4e-91dc-0cabeaa7d6bd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030425 Jul 27 20:56:40.605531 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1166/2474] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:56:41.569607 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9b31226b-0dbc-4182-9ddc-8e83c17f5752 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:41.571722 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9b31226b-0dbc-4182-9ddc-8e83c17f5752 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:41.578883 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b31226b-0dbc-4182-9ddc-8e83c17f5752 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:41.579338 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b31226b-0dbc-4182-9ddc-8e83c17f5752 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:41.580145 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b31226b-0dbc-4182-9ddc-8e83c17f5752 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:41.580555 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b31226b-0dbc-4182-9ddc-8e83c17f5752 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:41.610161 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9b31226b-0dbc-4182-9ddc-8e83c17f5752 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Jul 27 20:56:41.610735 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1309/2475] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:56:41 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:56:42.623411 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a935ea36-946e-4850-b46d-3963d0d0215d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:42.625633 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a935ea36-946e-4850-b46d-3963d0d0215d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:42.631777 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a935ea36-946e-4850-b46d-3963d0d0215d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:42.632225 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a935ea36-946e-4850-b46d-3963d0d0215d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:42.633016 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a935ea36-946e-4850-b46d-3963d0d0215d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:42.633453 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a935ea36-946e-4850-b46d-3963d0d0215d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:42.660922 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a935ea36-946e-4850-b46d-3963d0d0215d tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042347 Jul 27 20:56:42.661476 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1167/2476] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 20:56:42 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:56:42.672304 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:42.672833 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:42.679328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:42.679770 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:42.680554 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:42.680985 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:42.754181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] HTTP exception thrown: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 is not attached to volume c8a94d50-e3f4-4a04-aa37-b01280881f69 Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Request method failure captured: Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments/c8a94d50-e3f4-4a04-aa37-b01280881f69 HTTP/1.1 Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept: application/json Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Connection: close Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Host: 10.222.0.47 Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.10 Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABi4aYErmzp8yQSEqiWlxLUMa1MixIQaCTP7M8LpEQZtLT2G1_ymR1olex8rSmCDOjaPbaJfIKYF192152NBrWHm1_RSqCBg0gZ4ecdB3uLAzUZIorILSEDvVRy-vmWugsl7cAIOEN2penz8txnaYFr50U1Cm_voFsp7SrXMW2N3bTdhd8 Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Id: 155ced356cdb445c904f0eba6a929ebe Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-TestMinimumBasicScenario-2132845468 Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Role: reader,member Jul 27 20:56:42.756556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Roles: reader,member Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/155ced356cdb445c904f0eba6a929ebe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/155ced356cdb445c904f0eba6a929ebe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/155ced356cdb445c904f0eba6a929ebe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_155ced356cdb445c904f0eba6a929ebe", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-TestMinimumBasicScenario-2132845468 Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 155ced356cdb445c904f0eba6a929ebe Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2132845468 Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User: tempest-TestMinimumBasicScenario-2132845468-project Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Id: 21324556c57e491db51f1a62f08ead79 Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-TestMinimumBasicScenario-2132845468-project Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: method: > Jul 27 20:56:42.757916 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: exception: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 is not attached to volume c8a94d50-e3f4-4a04-aa37-b01280881f69 Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: action_args: {'server_id': '8fa131d5-2538-4a9b-bf47-28dcfce17068', 'id': 'c8a94d50-e3f4-4a04-aa37-b01280881f69'} Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c8a94d50-e3f4-4a04-aa37-b01280881f69. Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:56:42.758683 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 is not attached to volume c8a94d50-e3f4-4a04-aa37-b01280881f69 Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 is not attached to volume c8a94d50-e3f4-4a04-aa37-b01280881f69 Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jul 27 20:56:42.759608 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Returning 404 to user: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 is not attached to volume c8a94d50-e3f4-4a04-aa37-b01280881f69 {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:56:42.760328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-193db9ef-5c00-404e-9c09-426b279b1070 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments/c8a94d50-e3f4-4a04-aa37-b01280881f69" status: 404 len: 154 microversion: 2.1 time: 0.089662 Jul 27 20:56:42.760328 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1310/2477] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 20:56:42 2022] DELETE /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068/os-volume_attachments/c8a94d50-e3f4-4a04-aa37-b01280881f69 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:56:44.034072 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bb1a1fd7-ffea-482b-b624-27458a838342 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:44.034589 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bb1a1fd7-ffea-482b-b624-27458a838342 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:44.040673 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb1a1fd7-ffea-482b-b624-27458a838342 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:44.041114 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb1a1fd7-ffea-482b-b624-27458a838342 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:44.041854 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb1a1fd7-ffea-482b-b624-27458a838342 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:44.042280 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bb1a1fd7-ffea-482b-b624-27458a838342 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:44.065829 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bb1a1fd7-ffea-482b-b624-27458a838342 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:56:44.377107 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bb1a1fd7-ffea-482b-b624-27458a838342 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 204 len: 0 microversion: 2.1 time: 0.346488 Jul 27 20:56:44.377706 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1168/2478] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 20:56:44 2022] DELETE /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:56:44.386380 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eef634be-2f53-45cd-a54b-83344d626791 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:44.387685 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eef634be-2f53-45cd-a54b-83344d626791 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:44.394379 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eef634be-2f53-45cd-a54b-83344d626791 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:44.394834 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eef634be-2f53-45cd-a54b-83344d626791 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:44.395579 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eef634be-2f53-45cd-a54b-83344d626791 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:44.396057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eef634be-2f53-45cd-a54b-83344d626791 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:44.531832 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eef634be-2f53-45cd-a54b-83344d626791 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:56:44.540138 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eef634be-2f53-45cd-a54b-83344d626791 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1553 microversion: 2.1 time: 0.157963 Jul 27 20:56:44.540804 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1311/2479] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:44 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:56:45.561921 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b3d727ff-8f05-4d8e-9d61-5f97f460ed42 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:45.562623 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b3d727ff-8f05-4d8e-9d61-5f97f460ed42 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:45.569029 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3d727ff-8f05-4d8e-9d61-5f97f460ed42 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:45.569476 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3d727ff-8f05-4d8e-9d61-5f97f460ed42 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:45.570223 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3d727ff-8f05-4d8e-9d61-5f97f460ed42 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:45.570662 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3d727ff-8f05-4d8e-9d61-5f97f460ed42 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:45.697249 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b3d727ff-8f05-4d8e-9d61-5f97f460ed42 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:56:45.704609 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b3d727ff-8f05-4d8e-9d61-5f97f460ed42 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1553 microversion: 2.1 time: 0.146872 Jul 27 20:56:45.705174 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1169/2480] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:45 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:56:46.727072 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3b0aea1c-3924-442b-a6f2-847041756b93 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:46.727681 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3b0aea1c-3924-442b-a6f2-847041756b93 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:46.734851 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b0aea1c-3924-442b-a6f2-847041756b93 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:46.735310 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b0aea1c-3924-442b-a6f2-847041756b93 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:46.736055 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b0aea1c-3924-442b-a6f2-847041756b93 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:46.736514 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b0aea1c-3924-442b-a6f2-847041756b93 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:46.900884 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3b0aea1c-3924-442b-a6f2-847041756b93 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:56:46.908480 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3b0aea1c-3924-442b-a6f2-847041756b93 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1553 microversion: 2.1 time: 0.186636 Jul 27 20:56:46.909054 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1312/2481] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:46 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:56:47.015317 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-11134fd0-2f23-4e30-a560-40d3ce0744f2 req-feba7516-cc55-402b-aff5-135b9fe0d947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa131d5-2538-4a9b-bf47-28dcfce17068", "name": "network-vif-deleted", "tag": "cf524f13-8f20-4148-b736-438d1cbcc5e1"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:56:47.026268 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-11134fd0-2f23-4e30-a560-40d3ce0744f2 req-feba7516-cc55-402b-aff5-135b9fe0d947 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:47.026760 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-11134fd0-2f23-4e30-a560-40d3ce0744f2 req-feba7516-cc55-402b-aff5-135b9fe0d947 service nova] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:47.037828 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-11134fd0-2f23-4e30-a560-40d3ce0744f2 req-feba7516-cc55-402b-aff5-135b9fe0d947 service nova] Creating event network-vif-deleted:cf524f13-8f20-4148-b736-438d1cbcc5e1 for instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 on hv-cinder-85124 Jul 27 20:56:47.043226 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-11134fd0-2f23-4e30-a560-40d3ce0744f2 req-feba7516-cc55-402b-aff5-135b9fe0d947 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031730 Jul 27 20:56:47.043812 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1170/2482] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 20:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:56:47.930271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:47.930823 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:47.937271 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:47.937723 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:47.938488 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:47.938920 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:47.970291 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:47.970738 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:47.971186 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lazy-loading 'fault' on Instance uuid 8fa131d5-2538-4a9b-bf47-28dcfce17068 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:56:48.012079 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21324556c57e491db51f1a62f08ead79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155ced356cdb445c904f0eba6a929ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:56:48.019057 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bc670b5b-6db4-4560-8e7a-c258465a7fdb tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 200 len: 1347 microversion: 2.1 time: 0.093417 Jul 27 20:56:48.019643 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1313/2483] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:47 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 1347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:56:49.040675 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:49.041408 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] [instance: 8fa131d5-2538-4a9b-bf47-28dcfce17068] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:56:49.047570 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:49.048024 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:49.048810 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:56:49.049287 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Lock "deef0dc2-6aba-4ad7-810e-4420c759a7c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:56:49.062819 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] HTTP exception thrown: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 could not be found. Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Request method failure captured: Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 HTTP/1.1 Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept: application/json Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Connection: close Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Host: 10.222.0.47 Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.10 Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABi4aYErmzp8yQSEqiWlxLUMa1MixIQaCTP7M8LpEQZtLT2G1_ymR1olex8rSmCDOjaPbaJfIKYF192152NBrWHm1_RSqCBg0gZ4ecdB3uLAzUZIorILSEDvVRy-vmWugsl7cAIOEN2penz8txnaYFr50U1Cm_voFsp7SrXMW2N3bTdhd8 Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Id: 155ced356cdb445c904f0eba6a929ebe Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-TestMinimumBasicScenario-2132845468 Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Role: reader,member Jul 27 20:56:49.064424 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Roles: reader,member Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/155ced356cdb445c904f0eba6a929ebe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/155ced356cdb445c904f0eba6a929ebe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/155ced356cdb445c904f0eba6a929ebe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_155ced356cdb445c904f0eba6a929ebe", "adminURL": "http://10.222.0.47:8080"}]}] Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-TestMinimumBasicScenario-2132845468 Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 155ced356cdb445c904f0eba6a929ebe Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2132845468 Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User: tempest-TestMinimumBasicScenario-2132845468-project Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Id: 21324556c57e491db51f1a62f08ead79 Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-TestMinimumBasicScenario-2132845468-project Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: method: > Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: exception: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 could not be found. Jul 27 20:56:49.065427 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: action_args: {'id': '8fa131d5-2538-4a9b-bf47-28dcfce17068'} Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 could not be found. Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:56:49.066086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 could not be found. Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 could not be found. Jul 27 20:56:49.067217 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jul 27 20:56:49.068086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Returning 404 to user: Instance 8fa131d5-2538-4a9b-bf47-28dcfce17068 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:56:49.068086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f0080ef9-b5bb-4595-be2d-731424d6da3c tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068" status: 404 len: 111 microversion: 2.1 time: 0.030519 Jul 27 20:56:49.068086 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1171/2484] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 20:56:49 2022] GET /compute/v2.1/servers/8fa131d5-2538-4a9b-bf47-28dcfce17068 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:56:49.074426 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-468829ac-e441-4243-8298-6f139d2f8771 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] Calling method '.version_select at 0x7f35ca2593a0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:56:49.184530 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-468829ac-e441-4243-8298-6f139d2f8771 tempest-TestMinimumBasicScenario-2132845468 tempest-TestMinimumBasicScenario-2132845468-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-322762962" status: 202 len: 0 microversion: 2.1 time: 0.113789 Jul 27 20:56:49.185129 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1314/2485] 10.222.0.47 () {58 vars in 1269 bytes} [Wed Jul 27 20:56:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-322762962 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:57:04.566309 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:57:04.566833 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 20:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:58:33.613556 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:58:33.614123 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:58:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:59:08.341354 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:59:08.341848 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 20:59:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:00:09.888892 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:00:09.889516 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 21:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:00:24.575229 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:00:24.575797 dv-cinder-851249-1-iscsi devstack@n-api.service[118273]: Wed Jul 27 21:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:01:49.287187 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:01:49.287703 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 21:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:01:53.621181 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:01:53.621802 dv-cinder-851249-1-iscsi devstack@n-api.service[118274]: Wed Jul 27 21:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!